-- Logs begin at Wed 2022-09-07 15:16:10 UTC, end at Wed 2022-09-07 16:19:51 UTC. -- Sep 07 15:47:16.887918 dv-cinder-853315-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 07 15:47:16.896734 dv-cinder-853315-8-iscsi devstack@n-api.service[105476]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 07 15:47:16.898673 dv-cinder-853315-8-iscsi devstack@n-api.service[105476]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 7 15:47:16 2022] *** Sep 07 15:47:16.898673 dv-cinder-853315-8-iscsi devstack@n-api.service[105476]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 07 15:47:16.898673 dv-cinder-853315-8-iscsi devstack@n-api.service[105476]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 07 15:47:16.898673 dv-cinder-853315-8-iscsi devstack@n-api.service[105476]: nodename: dv-cinder-853315-8-iscsi Sep 07 15:47:16.898673 dv-cinder-853315-8-iscsi devstack@n-api.service[105476]: machine: x86_64 Sep 07 15:47:16.898673 dv-cinder-853315-8-iscsi devstack@n-api.service[105476]: clock source: unix Sep 07 15:47:16.898673 dv-cinder-853315-8-iscsi devstack@n-api.service[105476]: pcre jit disabled Sep 07 15:47:16.898673 dv-cinder-853315-8-iscsi devstack@n-api.service[105476]: detected number of CPU cores: 4 Sep 07 15:47:16.898673 dv-cinder-853315-8-iscsi devstack@n-api.service[105476]: current working directory: / Sep 07 15:47:16.898673 dv-cinder-853315-8-iscsi devstack@n-api.service[105476]: detected binary path: /usr/bin/uwsgi-core Sep 07 15:47:16.899418 dv-cinder-853315-8-iscsi devstack@n-api.service[105476]: your processes number limit is 47680 Sep 07 15:47:16.899418 dv-cinder-853315-8-iscsi devstack@n-api.service[105476]: your memory page size is 4096 bytes Sep 07 15:47:16.899418 dv-cinder-853315-8-iscsi devstack@n-api.service[105476]: detected max file descriptor number: 2048 Sep 07 15:47:16.899418 dv-cinder-853315-8-iscsi devstack@n-api.service[105476]: lock engine: pthread robust mutexes Sep 07 15:47:16.899418 dv-cinder-853315-8-iscsi devstack@n-api.service[105476]: thunder lock: enabled Sep 07 15:47:16.899418 dv-cinder-853315-8-iscsi devstack@n-api.service[105476]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 07 15:47:16.899418 dv-cinder-853315-8-iscsi devstack@n-api.service[105476]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 07 15:47:16.938471 dv-cinder-853315-8-iscsi devstack@n-api.service[105476]: Python main interpreter initialized at 0x5585ba0649c0 Sep 07 15:47:16.938471 dv-cinder-853315-8-iscsi devstack@n-api.service[105476]: python threads support enabled Sep 07 15:47:16.938471 dv-cinder-853315-8-iscsi devstack@n-api.service[105476]: your server socket listen backlog is limited to 100 connections Sep 07 15:47:16.938471 dv-cinder-853315-8-iscsi devstack@n-api.service[105476]: your mercy for graceful operations on workers is 90 seconds Sep 07 15:47:16.938787 dv-cinder-853315-8-iscsi devstack@n-api.service[105476]: mapped 403077 bytes (393 KB) for 2 cores Sep 07 15:47:16.938869 dv-cinder-853315-8-iscsi devstack@n-api.service[105476]: *** Operational MODE: preforking *** Sep 07 15:47:16.939125 dv-cinder-853315-8-iscsi devstack@n-api.service[105476]: *** uWSGI is running in multiple interpreter mode *** Sep 07 15:47:16.939125 dv-cinder-853315-8-iscsi devstack@n-api.service[105476]: spawned uWSGI master process (pid: 105476) Sep 07 15:47:16.939301 dv-cinder-853315-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 07 15:47:16.940690 dv-cinder-853315-8-iscsi devstack@n-api.service[105476]: spawned uWSGI worker 1 (pid: 105477, cores: 1) Sep 07 15:47:16.940690 dv-cinder-853315-8-iscsi devstack@n-api.service[105476]: spawned uWSGI worker 2 (pid: 105478, cores: 1) Sep 07 15:47:16.940690 dv-cinder-853315-8-iscsi devstack@n-api.service[105476]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 07 15:47:17.591789 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 07 15:47:17.592377 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 07 15:47:18.677560 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 15:47:18.677560 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: from cryptography.utils import int_from_bytes Sep 07 15:47:18.678135 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 15:47:18.678135 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: from cryptography.utils import int_from_bytes Sep 07 15:47:18.681597 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 15:47:18.681597 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: from cryptography.utils import int_from_bytes Sep 07 15:47:18.682043 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 15:47:18.682043 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: from cryptography.utils import int_from_bytes Sep 07 15:47:21.178820 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 07 15:47:21.179297 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 07 15:47:21.179394 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 07 15:47:21.179394 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 07 15:47:21.179878 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 07 15:47:21.179968 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 07 15:47:21.180055 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 07 15:47:21.180219 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 07 15:47:21.180315 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 07 15:47:21.180530 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 07 15:47:21.180625 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.180921 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.181019 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.181238 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.181329 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.181554 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.181646 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.181875 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.181981 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.182179 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.182275 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.182501 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.182602 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.182815 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.182907 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.183132 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.183225 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.183388 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.183483 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.183735 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.183843 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.184052 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.184145 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853315-8-iscsi {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.184369 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.184465 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853315-8-iscsi {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.184675 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.184774 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.184980 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.185071 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.185289 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.185381 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.185586 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.185679 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.185891 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.185977 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.186192 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.186283 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.186496 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.186693 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.187081 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.187227 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.187336 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.187451 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.187591 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.187769 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.187963 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.188101 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.188241 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.188396 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.188558 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.188741 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.188912 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.189051 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.189170 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.189318 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.189477 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.189639 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.189813 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.189943 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.190106 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.190340 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853315-8-iscsi {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.190501 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853315-8-iscsi {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.190663 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.190820 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.190974 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.191134 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.191287 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.191449 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.191719 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.191898 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.192039 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.192196 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.192322 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.192504 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.192642 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.192829 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.192964 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.193153 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.193268 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.193459 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.193594 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.193785 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.193911 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.194104 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.194227 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.194423 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.194543 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.194741 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.194833 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.195041 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.195138 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.195351 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.195443 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.195682 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.195789 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.196001 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.196088 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.196304 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.196391 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.196560 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.196658 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.196840 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.196943 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.197145 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.197239 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.197467 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.197567 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.197785 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.197874 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.198037 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.198130 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.198288 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.198446 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.198577 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.198669 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.198897 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.198984 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.199206 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.199292 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.199512 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.199641 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.199844 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.199949 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.200150 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.200242 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.200456 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.200542 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.200765 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.200858 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.201067 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.201153 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.201369 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.201454 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.201671 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.201768 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.201984 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.202078 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.202295 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.202386 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.202601 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.202695 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.202915 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.203009 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.203236 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.203921 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.204093 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.204185 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.204401 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.204493 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.204713 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.204809 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.205048 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.205140 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.205356 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.205443 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.205662 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.205757 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.205980 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.206074 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.206288 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.206382 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.206593 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.206688 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.206896 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.206988 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.207199 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.207290 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.207520 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.207681 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.207856 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.207943 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.208106 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.208193 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.208403 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.208570 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.208706 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.208793 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.209012 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.209099 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.209317 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.209410 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.209622 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.209723 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.209923 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.210015 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.210219 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.210313 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.210513 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.210605 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.210819 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.210916 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.211119 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.211206 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.211420 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.211504 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.211746 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.211918 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.212032 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.212114 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.212337 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.212430 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.212636 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.212721 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.212938 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.213029 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.213238 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.213330 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.213540 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.213626 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.213856 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.213941 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.214161 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.214253 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.214463 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.214557 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.214764 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.214859 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.215066 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.215158 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.215372 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.215465 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.215698 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.215796 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.216005 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.216098 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.216306 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.216391 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.216611 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.216705 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.216911 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.216996 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.217213 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.217306 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.217513 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.217599 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.217816 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.217903 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.218116 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.218210 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.218415 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.218507 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.218716 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.218812 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.219609 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.219720 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.219922 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.220064 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.220226 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.220314 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.220526 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.220621 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.220828 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.220914 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.221124 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.221209 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.221421 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.221517 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.221717 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.221821 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.222012 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.222098 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.222306 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.222457 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.222603 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.222689 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.222904 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.223042 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.223220 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.223354 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.223523 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.223670 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.223848 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.223978 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.224149 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.224278 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.224467 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:47:21.224604 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.224800 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.224930 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.225129 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.225275 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.225444 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.225587 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.225770 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.225910 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.226100 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.226228 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.226417 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.226547 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.226729 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.226875 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.227038 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.227168 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.227354 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.227491 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.227674 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.227822 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.227988 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.228379 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.228553 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.228688 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.228850 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.228981 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.229166 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.229310 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.229485 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.229627 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.229798 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.230002 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.230154 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.230288 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.230418 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.230558 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.230715 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.230868 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.231006 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.231136 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.231325 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.231460 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.231677 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.231822 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.231986 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.232118 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.232298 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.232429 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.232642 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.232774 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.232954 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.233048 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.233279 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.233367 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.233601 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.233698 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.233907 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.233992 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.234281 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.234388 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.234522 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.234643 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.234854 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.234940 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.235198 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.235295 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.235507 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.235640 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.235843 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.235934 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.236152 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.236246 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.236461 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.236547 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.236770 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.236901 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.237077 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.237178 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.237386 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.237477 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.237693 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.237778 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.238001 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.238095 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.238309 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.238402 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.238635 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.238722 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.238948 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.239034 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.239262 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.239346 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.239595 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.239697 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.239914 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.240000 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.240252 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.240351 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.240534 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.240620 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.240842 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.240928 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.241142 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.241234 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.241443 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.241540 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.241743 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.241836 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.242044 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.242140 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.242343 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.242428 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.242649 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.242734 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.242970 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.243055 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.243272 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.243366 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.243625 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.243725 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.243933 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.244029 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.244241 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.244337 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.244550 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.244635 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.244855 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.244948 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.245160 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.245256 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.245461 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.245553 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.245766 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.245851 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.246068 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.246162 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.246368 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.246461 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.246684 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.246777 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.246988 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.247079 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.247288 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.247381 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.247622 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.247722 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.247929 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.248016 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.248243 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.248343 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.248554 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.248640 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.248865 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.248960 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.249173 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.249264 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.249478 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.249572 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.249785 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.249879 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.250096 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.250671 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.250924 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.251027 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.251234 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.251328 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.251591 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.251679 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.251901 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.252015 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.252219 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.252312 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.252540 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.252633 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.252856 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.252951 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.253159 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.253249 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.253465 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.253551 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.253765 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.253919 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.254066 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.254152 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.254366 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.254453 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.254664 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.254750 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.254962 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.255048 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.255262 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.255348 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.255596 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.255700 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.255883 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.255977 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.256184 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.256270 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.256488 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.256576 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.256792 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.256877 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.257093 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.257179 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.257390 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.257477 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.257688 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.257780 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.257985 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.258080 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.258318 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.258409 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.258618 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.258702 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.258956 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.259119 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.259272 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.259367 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.259616 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.259704 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.259931 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.260031 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.260240 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.260325 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.260543 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.260637 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.260849 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.260946 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.261159 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.261245 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.261464 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.261548 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.261772 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.261858 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.262078 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.262162 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.262384 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.262468 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.262689 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.262783 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.262997 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.263097 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.263303 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.263397 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.263643 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.263734 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.263947 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.264046 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.264251 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.264343 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.264563 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.264651 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.264902 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.264988 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.265216 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.265302 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.265529 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.265622 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.265882 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.266485 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.266697 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.266797 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.267162 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.267298 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.267430 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.267516 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.267613 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.267715 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.267919 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.268008 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.268227 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.268312 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.268532 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.268629 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.268843 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.268928 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.269147 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.269268 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.269458 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.269552 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.269761 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.269847 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.270075 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.270161 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.270372 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.270471 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.270680 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.270766 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.270988 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.271082 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.271316 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.271403 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.271649 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.271737 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.271962 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.272047 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.272272 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.272366 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.272577 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.272662 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.272886 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.272971 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.273194 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.273390 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.273498 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.273584 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.273797 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.273892 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.274101 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.274200 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.274405 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.274499 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.274708 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.274807 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.275013 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.275100 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.275316 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.275403 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.275642 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.275747 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.275947 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.276033 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.276248 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.276343 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.276549 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.276644 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.276852 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.276938 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.277164 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.277250 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.277470 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.277564 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.277782 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.277875 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.278098 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.278182 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.278399 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.278487 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.278701 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.278793 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.279004 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.279090 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.279308 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.279401 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.279637 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.279726 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.279942 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.280029 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.280239 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.280325 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.280539 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.280632 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.280875 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.280960 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.281180 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.281269 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.281510 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.281600 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.281827 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.281922 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.282147 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.282232 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.282456 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.282541 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.282761 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.282909 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.283067 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.283197 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.283378 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.283520 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.283701 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.283858 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.283999 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.284131 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.284304 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.284446 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.284613 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.284755 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.284919 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.285060 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.285225 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.285358 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.285536 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.285672 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.285838 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.285978 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.286148 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.286289 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.286453 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.286586 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.286752 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.286886 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.287051 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.287193 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.287360 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.287512 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.287701 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.287961 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.288264 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.288399 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.288612 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.288752 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.288885 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.289031 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.289203 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.289345 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.289522 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.289685 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.289831 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.289972 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.290162 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.290289 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.290476 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.290617 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.290780 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.290914 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.291083 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.291224 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.291389 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.291475 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.291716 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.291805 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.292023 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.292110 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.292321 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.292423 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.292625 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.292710 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.292924 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.293012 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.293231 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.293325 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.293529 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.293614 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.293827 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.293919 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.294127 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.294226 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.294426 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.294511 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.294730 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.294817 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.295030 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.295183 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.295333 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.295419 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.295657 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.295746 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.295959 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.296046 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.296276 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.296362 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.296577 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.296664 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.296878 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.296964 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.297202 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.297296 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.297503 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.297589 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.297835 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.297921 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.298136 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.298221 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.298473 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.298561 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.298803 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.298898 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.299102 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.299187 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.299406 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.299501 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.299750 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.299837 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.300050 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.300144 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.300353 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.300449 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.300653 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.300739 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.300955 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.301040 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.301260 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.301357 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.301558 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.301643 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.301857 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.301943 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.302159 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.302245 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.302464 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.302549 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.302766 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.302866 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.303064 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.303151 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.303367 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.303461 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.303691 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.303778 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.303992 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.304079 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.304298 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.304384 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.304598 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.304693 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.304898 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.304984 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.305200 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.305287 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.305500 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.305585 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.305800 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.305895 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.306096 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.306190 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.306393 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.306487 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.306691 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.306788 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.306993 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.307113 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.307294 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.307433 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.307618 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.307775 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.307927 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.308083 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.308236 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.308396 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.308531 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.308704 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.308850 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.309007 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.309158 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.309331 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.309458 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.309644 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.309758 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.309949 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.310064 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.310253 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.310366 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.310560 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.310666 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.310863 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.310959 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.311165 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.311275 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.311475 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.311615 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.311821 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.311993 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.312139 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.312228 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.312445 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.312531 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.313268 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.313387 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.313572 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.313692 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.313874 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.313962 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.314174 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.314280 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.314474 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.314560 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.314772 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.314864 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.315072 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.315159 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.315370 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.315486 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.315719 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.315838 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.316007 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.316101 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.316307 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.316394 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.316611 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.316697 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.316913 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.317009 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.317258 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.317345 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.317556 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.317649 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.317903 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.317989 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.318204 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.318331 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.318517 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.318613 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.318835 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.318921 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.319146 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.319238 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.319456 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.319568 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.319791 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.319888 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.320090 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.320184 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.320404 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.320502 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.320708 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.320792 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.321019 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.321105 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.321319 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.321407 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.321629 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.321723 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.321934 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.322020 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.322238 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.322325 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.322542 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.322628 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.322856 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.322941 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.323169 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.323257 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.323487 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.323623 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.323817 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.324019 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.324120 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.324201 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.324418 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.324505 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.324724 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.324818 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.325026 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.325113 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.325331 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.325416 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.325638 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.325733 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.325944 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.326029 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.326251 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.326337 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.326558 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.326652 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.326864 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.326949 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.327167 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.327253 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.327473 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.327586 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.327805 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.327891 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.328114 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.328199 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.328471 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.328563 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.328781 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.328868 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.329105 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.329192 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.329414 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.329501 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.329714 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.329814 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.330022 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.330118 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.330321 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.330415 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.330627 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.330745 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.330932 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.331058 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.331358 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.331446 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.331689 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.331785 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.331998 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.332095 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.332303 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.332390 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.332616 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.332701 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.332923 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.333021 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.333224 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.333309 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.333538 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.333623 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.333847 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.333941 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.334226 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.334312 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.334537 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.334622 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.334840 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.334934 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.335144 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.335237 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.335450 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.335535 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.335780 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.335876 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.336087 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.336173 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.336391 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.336477 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.336696 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.336783 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.336996 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.337095 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.337302 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.337389 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.337617 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.337710 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.337917 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.338028 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.338239 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.338326 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.338625 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.338711 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.338953 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.339038 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.339261 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.339356 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.339649 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.339751 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.339973 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.340095 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.340293 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.340391 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.340612 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.340706 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.340917 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.341010 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.341231 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.341317 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.341534 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.341627 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.341851 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.341947 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.342160 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.342247 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.342464 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.342559 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.342775 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.342862 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.343077 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.343165 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.343386 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.343481 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.343717 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.343807 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.344555 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.344663 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.344875 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.344963 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.345192 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.345278 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.345517 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.345604 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.345888 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.345974 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.346210 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.346297 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.346535 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.346630 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.346839 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.346934 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.347141 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.347227 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.347446 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.347534 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.347774 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.347861 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.348075 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.348160 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.348376 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.348474 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.348682 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.348769 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.348988 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.349073 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.349295 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.349389 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.349596 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.349682 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.349898 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.349984 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.350200 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.350310 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.350504 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.350600 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.350805 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.350893 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.351123 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.351218 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.351422 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.351509 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.351769 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.351857 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.352084 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.352172 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.352385 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.352486 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.352708 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.352795 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.353009 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.353104 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.353562 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.353649 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.353867 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.353955 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.354168 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.354262 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.354470 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.354556 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.354775 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.354870 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.355109 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.355196 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.355411 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.355497 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.355755 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.355855 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.356073 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.356159 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.356403 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.356489 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.356714 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.356810 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.357030 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.357116 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.357340 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.357426 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.357656 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.357751 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.357961 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.358048 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.358269 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.358355 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.358572 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.358672 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.358878 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.358966 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.359177 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.359265 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.359480 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.359638 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.359851 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.359945 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.360156 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.360243 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.360457 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.360567 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.360767 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.360873 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.361066 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.361152 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.361368 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.361455 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.361667 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.361754 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.361986 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.362080 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.362284 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.362380 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.362587 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.362674 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.362892 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.362989 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.363190 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.363276 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.363494 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.363600 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.363821 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.363921 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.364155 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.364241 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.364459 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.364545 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.364777 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.364871 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.365082 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.365175 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.365393 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.365486 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.365706 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.365800 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.366019 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.366104 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.366331 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.366417 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.366644 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.366732 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.366954 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.367040 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.367263 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.367348 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.367595 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.367697 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.367911 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.367997 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.368225 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.368310 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.368543 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.368743 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.368878 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.369071 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.369372 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.369465 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.369682 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.369770 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.369994 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.370080 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.370307 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.370401 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.370618 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.370705 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.370931 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.371029 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.371236 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.371331 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.371572 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.371674 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.371878 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.372003 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.372187 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.372282 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.372500 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.372587 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.372831 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.372918 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.373152 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.373241 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.373469 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.373562 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.373787 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.373882 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.374104 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.374202 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.374420 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.374513 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.374735 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.374860 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.375054 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.375142 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.375930 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.376017 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.376248 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.376348 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.376567 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.376660 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.376883 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.376970 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.377199 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.377294 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.377509 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.377595 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.377819 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.377904 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.378129 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.378216 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.378440 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.378526 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.378749 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.378835 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.379059 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.379154 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.379370 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.379455 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.379720 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.379820 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.380040 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.380128 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.380360 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.380446 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.380674 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.380770 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.380993 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.381091 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.381304 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.381390 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.381623 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.381818 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.381943 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.382138 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.382459 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.382565 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.382775 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.382876 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.383094 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.383181 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.383409 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.383497 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.383751 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.383848 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.384064 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.384150 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.384367 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.384461 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.384671 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.384760 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.384981 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.385088 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.385281 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.385369 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.385580 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.385668 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.385887 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.385976 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.386191 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.386278 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.386491 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.386587 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.386808 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.386902 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.387112 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.387212 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.387426 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.387670 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.387762 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.388022 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.388275 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.388375 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.388623 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.388719 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.388940 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.389043 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.389269 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.389381 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.389572 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.389660 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.389895 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.389981 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.390200 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.390333 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.390507 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.390594 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.390862 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.390948 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.391173 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.391262 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.391477 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.391590 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.391815 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.391902 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.392183 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.392283 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.392426 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.392514 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.392739 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.392835 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.393049 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.393145 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.393352 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.393439 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.393658 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.393752 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.393962 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.394052 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.394265 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.394351 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.394573 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.394669 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.394878 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.395047 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.395180 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.395267 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.395484 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.395619 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.395814 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.395901 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.396115 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.396207 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.396415 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.396581 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.396717 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.396811 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.397025 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.397111 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.397323 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.397419 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.397629 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.397717 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.397934 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.398023 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.398247 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.398343 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.398554 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.398640 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.398877 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.398964 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.399180 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.399281 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.399483 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.399609 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.399821 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.399919 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.400125 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.400214 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.400443 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.400530 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.400748 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.400834 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.401057 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.401153 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.401367 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.401459 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.401677 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.401775 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.402024 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.402229 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.402357 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.402550 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.402856 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.402954 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.403189 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.403275 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.403507 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.403640 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.403837 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.403979 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.404143 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.404231 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.404448 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.404543 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.404770 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.404867 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.405081 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.405210 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.405383 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.405471 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.405692 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.405779 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.405999 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.406085 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.406308 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.406402 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.407136 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.407224 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.407443 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.407537 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.407777 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.407863 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.408084 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.408172 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.408435 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.408531 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.408693 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.408790 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.408999 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.409093 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.409304 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.409398 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.409610 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.409716 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.409911 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.409998 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.410218 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.410305 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.410533 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.410631 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.410852 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.410940 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.411167 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.411261 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.411482 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.411611 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.411816 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.411903 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.412127 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.412214 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.412431 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.412518 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.412741 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.412828 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.413051 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.413138 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.413358 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.413453 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.413674 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.413761 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.413980 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.414075 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.414295 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.414607 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.414693 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.414942 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.415262 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.415362 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.415602 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.415694 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.415916 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.416003 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.416236 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.416336 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.416549 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.416645 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.416861 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.416954 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.417182 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.417271 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.417490 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.417576 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.417808 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.417904 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.418120 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.418208 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.418449 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.418536 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.418771 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.418857 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.419076 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.419164 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.419380 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.419467 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.419726 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.419826 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.420033 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.420121 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.420339 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.420433 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.420645 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.420740 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.420950 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.421037 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.421254 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.421341 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.421554 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.421652 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.421853 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.421946 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.422206 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.422292 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.422509 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.422608 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.422811 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.422897 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.423116 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.423203 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.423415 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.423502 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.423744 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.423833 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.424047 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.424134 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.424350 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.424439 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.424658 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.424745 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.424961 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.425055 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.425265 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.425391 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.425569 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.425655 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.425871 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.425957 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.426169 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.426258 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.426470 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.426556 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.426766 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.426861 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.427066 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.427159 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.427369 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.427464 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.427723 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.427835 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.428053 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.428139 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.428363 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.428450 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.428682 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.428777 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.428990 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.429085 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.429308 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.429394 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.429614 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.429709 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.429932 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.430019 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.430241 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.430327 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.430553 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.430648 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.430859 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.430954 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.431166 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.431258 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.431479 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.431607 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.431813 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.431900 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.432119 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.432206 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.432426 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.432521 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.432734 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.432825 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.433041 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.433136 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.433356 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.433444 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.433746 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.433845 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.433994 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.434096 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.434318 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.434404 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.434633 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.434722 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.434944 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.435040 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.435255 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.435341 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.435590 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.435733 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.435906 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.436021 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.436215 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.436304 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.436523 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.436609 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.436829 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.436917 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.437139 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.437233 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.437444 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.437530 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.438279 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.438378 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.438588 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.438674 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.438898 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.438984 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.439210 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.439297 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.439524 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.439627 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.439855 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.439951 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.440180 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.440266 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.440486 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.440572 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.440812 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.440911 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.441138 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.441224 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.441482 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.441568 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.441796 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.441891 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.442105 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.442197 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.442417 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.442510 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.442725 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.442825 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.442966 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 07 15:47:21.443056 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.443338 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:47:21.443601 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 07 15:47:21.595119 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: INFO dbcounter [None req-4d95e4f2-a5dd-431e-b450-fd7f1c74aa62 None None] Registered counter for database nova_api Sep 07 15:47:21.595322 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: INFO dbcounter [None req-9f6eead3-8ea6-4f01-acd6-8b950ea74ee6 None None] Registered counter for database nova_api Sep 07 15:47:21.615126 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG oslo_db.sqlalchemy.engines [None req-4d95e4f2-a5dd-431e-b450-fd7f1c74aa62 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105477) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 15:47:21.619018 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG oslo_db.sqlalchemy.engines [None req-9f6eead3-8ea6-4f01-acd6-8b950ea74ee6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105478) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 15:47:21.621862 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG dbcounter [-] [105477] Writer thread running {{(pid=105477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 15:47:21.625463 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG dbcounter [-] [105478] Writer thread running {{(pid=105478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 15:47:21.678655 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.context [None req-4d95e4f2-a5dd-431e-b450-fd7f1c74aa62 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),13f76085-40f9-4e0c-a81d-300476f83c4c(cell1) {{(pid=105477) load_cells /opt/stack/nova/nova/context.py:464}} Sep 07 15:47:21.681514 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.context [None req-9f6eead3-8ea6-4f01-acd6-8b950ea74ee6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),13f76085-40f9-4e0c-a81d-300476f83c4c(cell1) {{(pid=105478) load_cells /opt/stack/nova/nova/context.py:464}} Sep 07 15:47:21.682465 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG oslo_concurrency.lockutils [None req-4d95e4f2-a5dd-431e-b450-fd7f1c74aa62 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:47:21.682927 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG oslo_concurrency.lockutils [None req-4d95e4f2-a5dd-431e-b450-fd7f1c74aa62 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:47:21.684515 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG oslo_concurrency.lockutils [None req-4d95e4f2-a5dd-431e-b450-fd7f1c74aa62 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:47:21.685223 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG oslo_concurrency.lockutils [None req-4d95e4f2-a5dd-431e-b450-fd7f1c74aa62 None None] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:47:21.685372 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG oslo_concurrency.lockutils [None req-9f6eead3-8ea6-4f01-acd6-8b950ea74ee6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:47:21.685665 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG oslo_concurrency.lockutils [None req-4d95e4f2-a5dd-431e-b450-fd7f1c74aa62 None None] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:47:21.685779 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG oslo_concurrency.lockutils [None req-9f6eead3-8ea6-4f01-acd6-8b950ea74ee6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:47:21.687307 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG oslo_concurrency.lockutils [None req-9f6eead3-8ea6-4f01-acd6-8b950ea74ee6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:47:21.687677 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG oslo_concurrency.lockutils [None req-4d95e4f2-a5dd-431e-b450-fd7f1c74aa62 None None] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:47:21.688045 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG oslo_concurrency.lockutils [None req-9f6eead3-8ea6-4f01-acd6-8b950ea74ee6 None None] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:47:21.688484 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG oslo_concurrency.lockutils [None req-9f6eead3-8ea6-4f01-acd6-8b950ea74ee6 None None] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:47:21.689651 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: INFO dbcounter [None req-4d95e4f2-a5dd-431e-b450-fd7f1c74aa62 None None] Registered counter for database nova_cell0 Sep 07 15:47:21.690441 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG oslo_concurrency.lockutils [None req-9f6eead3-8ea6-4f01-acd6-8b950ea74ee6 None None] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:47:21.692480 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: INFO dbcounter [None req-9f6eead3-8ea6-4f01-acd6-8b950ea74ee6 None None] Registered counter for database nova_cell0 Sep 07 15:47:21.693644 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: INFO dbcounter [None req-4d95e4f2-a5dd-431e-b450-fd7f1c74aa62 None None] Registered counter for database nova_cell1 Sep 07 15:47:21.696380 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: INFO dbcounter [None req-9f6eead3-8ea6-4f01-acd6-8b950ea74ee6 None None] Registered counter for database nova_cell1 Sep 07 15:47:21.701681 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG oslo_db.sqlalchemy.engines [None req-4d95e4f2-a5dd-431e-b450-fd7f1c74aa62 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105477) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 15:47:21.702845 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG oslo_db.sqlalchemy.engines [None req-4d95e4f2-a5dd-431e-b450-fd7f1c74aa62 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105477) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 15:47:21.704835 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG oslo_db.sqlalchemy.engines [None req-9f6eead3-8ea6-4f01-acd6-8b950ea74ee6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105478) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 15:47:21.709313 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG dbcounter [-] [105478] Writer thread running {{(pid=105478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 15:47:21.709934 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG oslo_db.sqlalchemy.engines [None req-9f6eead3-8ea6-4f01-acd6-8b950ea74ee6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105478) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 15:47:21.710048 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG dbcounter [-] [105477] Writer thread running {{(pid=105477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 15:47:21.850271 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG dbcounter [-] [105477] Writer thread running {{(pid=105477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 15:47:21.851938 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG dbcounter [-] [105478] Writer thread running {{(pid=105478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 15:47:21.859620 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: INFO dbcounter [None req-4d95e4f2-a5dd-431e-b450-fd7f1c74aa62 None None] Registered counter for database nova_cell0 Sep 07 15:47:21.860819 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: INFO dbcounter [None req-9f6eead3-8ea6-4f01-acd6-8b950ea74ee6 None None] Registered counter for database nova_cell0 Sep 07 15:47:21.868443 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG oslo_db.sqlalchemy.engines [None req-4d95e4f2-a5dd-431e-b450-fd7f1c74aa62 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105477) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 15:47:21.870191 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG oslo_db.sqlalchemy.engines [None req-9f6eead3-8ea6-4f01-acd6-8b950ea74ee6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105478) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 15:47:21.873261 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG dbcounter [-] [105477] Writer thread running {{(pid=105477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 15:47:21.874771 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG dbcounter [-] [105478] Writer thread running {{(pid=105478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 15:47:22.214044 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: WARNING keystonemiddleware.auth_token [None req-9f6eead3-8ea6-4f01-acd6-8b950ea74ee6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 15:47:22.217966 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: WARNING keystonemiddleware.auth_token [None req-4d95e4f2-a5dd-431e-b450-fd7f1c74aa62 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 15:47:22.223341 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: WARNING keystonemiddleware.auth_token [None req-9f6eead3-8ea6-4f01-acd6-8b950ea74ee6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 15:47:22.225262 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: WARNING keystonemiddleware.auth_token [None req-4d95e4f2-a5dd-431e-b450-fd7f1c74aa62 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 15:47:22.561052 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: WARNING keystonemiddleware.auth_token [None req-9f6eead3-8ea6-4f01-acd6-8b950ea74ee6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 15:47:22.565530 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: WARNING keystonemiddleware.auth_token [None req-4d95e4f2-a5dd-431e-b450-fd7f1c74aa62 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 15:47:22.567466 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: WARNING keystonemiddleware.auth_token [None req-9f6eead3-8ea6-4f01-acd6-8b950ea74ee6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 15:47:22.572432 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: WARNING keystonemiddleware.auth_token [None req-4d95e4f2-a5dd-431e-b450-fd7f1c74aa62 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 15:47:22.574016 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5585ba0649c0 pid: 105478 (default app) Sep 07 15:47:22.576368 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-9f6eead3-8ea6-4f01-acd6-8b950ea74ee6 None None] Calling method '>' {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:47:22.577729 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-9f6eead3-8ea6-4f01-acd6-8b950ea74ee6 None None] 10.222.0.17 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002162 Sep 07 15:47:22.577864 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5585ba0649c0 pid: 105477 (default app) Sep 07 15:47:22.578138 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 1/1] 10.222.0.17 () {50 vars in 788 bytes} [Wed Sep 7 15:47:22 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:48:43.634931 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-4d95e4f2-a5dd-431e-b450-fd7f1c74aa62 None None] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:48:43.636418 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-4d95e4f2-a5dd-431e-b450-fd7f1c74aa62 None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002395 Sep 07 15:48:43.637089 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 1/2] 10.222.0.17 () {54 vars in 931 bytes} [Wed Sep 7 15:48:43 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:48:43.653901 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG dbcounter [-] [105478] Writing DB stats nova_api:SELECT=3 {{(pid=105478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:48:43.655536 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG dbcounter [-] [105478] Writing DB stats nova_cell0:SELECT=3 {{(pid=105478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:48:43.656677 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG dbcounter [-] [105478] Writing DB stats nova_cell1:SELECT=3 {{(pid=105478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:48:43.657953 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG dbcounter [-] [105478] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:48:44.544593 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-c29cae7c-370b-4bde-aa82-d42f9af024d2 admin admin] Calling method '>' {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:48:44.578413 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-c29cae7c-370b-4bde-aa82-d42f9af024d2 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.934979 Sep 07 15:48:44.579358 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 2/3] 10.222.0.17 () {60 vars in 1292 bytes} [Wed Sep 7 15:48:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:48:47.169317 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-4d95e4f2-a5dd-431e-b450-fd7f1c74aa62 None None] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:48:47.171720 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-4d95e4f2-a5dd-431e-b450-fd7f1c74aa62 None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001978 Sep 07 15:48:47.175946 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 2/4] 10.222.0.17 () {54 vars in 931 bytes} [Wed Sep 7 15:48:47 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:48:47.626672 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-e3d57465-13ee-446d-a734-947bbcc164f7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "disk": 1, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "rxtx_factor": 1.0, "ram": 256, "name": "cirros256"}} {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:48:47.673054 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-e3d57465-13ee-446d-a734-947bbcc164f7 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.495999 Sep 07 15:48:47.673618 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 3/5] 10.222.0.17 () {64 vars in 1283 bytes} [Wed Sep 7 15:48:47 2022] POST /compute/v2.1/flavors => generated 407 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 15:48:47.687965 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG dbcounter [-] [105477] Writing DB stats nova_api:SELECT=3 {{(pid=105477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:48:47.688771 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG dbcounter [-] [105477] Writing DB stats nova_cell1:SELECT=3 {{(pid=105477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:48:47.690698 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG dbcounter [-] [105477] Writing DB stats nova_cell0:SELECT=3 {{(pid=105477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:48:47.691752 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG dbcounter [-] [105477] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:48:47.894307 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-0e86ee8a-72ad-45ef-92c9-e58279640150 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:48:47.960719 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-0e86ee8a-72ad-45ef-92c9-e58279640150 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.278445 Sep 07 15:48:47.961313 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 3/6] 10.222.0.17 () {64 vars in 1336 bytes} [Wed Sep 7 15:48:47 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:48:50.530356 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-e3d57465-13ee-446d-a734-947bbcc164f7 admin admin] Calling method '>' {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:48:50.531374 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-e3d57465-13ee-446d-a734-947bbcc164f7 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Sep 07 15:48:50.531832 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 4/7] 10.222.0.17 () {54 vars in 931 bytes} [Wed Sep 7 15:48:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:48:51.184714 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-d3ea4430-33ea-4a99-8bf1-7f8df4f134e9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "name": "ds512M", "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 512, "disk": 5, "swap": 0}} {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:48:51.226608 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-d3ea4430-33ea-4a99-8bf1-7f8df4f134e9 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.687754 Sep 07 15:48:51.227396 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 4/8] 10.222.0.17 () {64 vars in 1283 bytes} [Wed Sep 7 15:48:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 15:48:51.240502 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-bb42a9d1-7f29-4cc8-be6b-7374479c9558 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:48:51.278128 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-bb42a9d1-7f29-4cc8-be6b-7374479c9558 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041396 Sep 07 15:48:51.279084 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 5/9] 10.222.0.17 () {64 vars in 1336 bytes} [Wed Sep 7 15:48:51 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:48:53.859973 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-d3ea4430-33ea-4a99-8bf1-7f8df4f134e9 admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:48:53.860979 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-d3ea4430-33ea-4a99-8bf1-7f8df4f134e9 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Sep 07 15:48:53.861358 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 5/10] 10.222.0.17 () {54 vars in 931 bytes} [Wed Sep 7 15:48:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:48:54.282460 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-c3cfdbd8-0e43-41e6-9ee9-2ffc853fc576 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 10, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "ds1G", "swap": 0}} {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:48:54.302490 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-c3cfdbd8-0e43-41e6-9ee9-2ffc853fc576 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.434707 Sep 07 15:48:54.303105 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 6/11] 10.222.0.17 () {64 vars in 1283 bytes} [Wed Sep 7 15:48:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 15:48:54.315228 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-e3f7b88f-853a-4a89-a6ec-2815d46b97db admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:48:54.342961 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-e3f7b88f-853a-4a89-a6ec-2815d46b97db admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031302 Sep 07 15:48:54.343609 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 6/12] 10.222.0.17 () {64 vars in 1336 bytes} [Wed Sep 7 15:48:54 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:48:57.000933 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-c3cfdbd8-0e43-41e6-9ee9-2ffc853fc576 admin admin] Calling method '>' {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:48:57.001860 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-c3cfdbd8-0e43-41e6-9ee9-2ffc853fc576 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Sep 07 15:48:57.002434 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 7/13] 10.222.0.17 () {54 vars in 931 bytes} [Wed Sep 7 15:48:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:48:57.423488 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-57397ad6-9b6b-4e62-ba3f-a0502f03c45b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "rxtx_factor": 1.0, "disk": 10, "id": "d3", "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "vcpus": 2}} {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:48:57.443377 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-57397ad6-9b6b-4e62-ba3f-a0502f03c45b admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.434601 Sep 07 15:48:57.447581 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 7/14] 10.222.0.17 () {64 vars in 1283 bytes} [Wed Sep 7 15:48:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 15:48:57.456691 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-d5e1715d-7d7e-41e1-a087-aaeaaf4516d0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:48:57.484763 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-d5e1715d-7d7e-41e1-a087-aaeaaf4516d0 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032135 Sep 07 15:48:57.485760 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 8/15] 10.222.0.17 () {64 vars in 1336 bytes} [Wed Sep 7 15:48:57 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:49:00.096654 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-57397ad6-9b6b-4e62-ba3f-a0502f03c45b admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:49:00.097984 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-57397ad6-9b6b-4e62-ba3f-a0502f03c45b admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Sep 07 15:49:00.098710 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 8/16] 10.222.0.17 () {54 vars in 931 bytes} [Wed Sep 7 15:49:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 15:49:00.551763 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-a5ee8fc6-5c5e-4c4c-9f7d-2080ec94e609 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 4, "rxtx_factor": 1.0, "id": "d4", "name": "ds4G", "disk": 20, "ram": 4096, "os-flavor-access:is_public": true}} {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:49:00.577147 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-a5ee8fc6-5c5e-4c4c-9f7d-2080ec94e609 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.470399 Sep 07 15:49:00.579588 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 9/17] 10.222.0.17 () {64 vars in 1283 bytes} [Wed Sep 7 15:49:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 15:49:00.590631 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-0bf91534-a578-4fe1-a140-7fef8c83e39f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:49:00.615638 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-0bf91534-a578-4fe1-a140-7fef8c83e39f admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029153 Sep 07 15:49:00.616272 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 9/18] 10.222.0.17 () {64 vars in 1336 bytes} [Wed Sep 7 15:49:00 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:49:03.205595 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-a5ee8fc6-5c5e-4c4c-9f7d-2080ec94e609 admin admin] Calling method '>' {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:49:03.206525 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-a5ee8fc6-5c5e-4c4c-9f7d-2080ec94e609 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Sep 07 15:49:03.206880 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 10/19] 10.222.0.17 () {54 vars in 931 bytes} [Wed Sep 7 15:49:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 15:49:03.627672 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-50c6e1cf-2b26-4d0f-aecf-ec932edf825b admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:49:03.659012 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-50c6e1cf-2b26-4d0f-aecf-ec932edf825b admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.445706 Sep 07 15:49:03.659747 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 10/20] 10.222.0.17 () {60 vars in 1292 bytes} [Wed Sep 7 15:49:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:49:06.291009 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-a5ee8fc6-5c5e-4c4c-9f7d-2080ec94e609 admin admin] Calling method '>' {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:49:06.292062 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-a5ee8fc6-5c5e-4c4c-9f7d-2080ec94e609 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Sep 07 15:49:06.292472 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 11/21] 10.222.0.17 () {54 vars in 931 bytes} [Wed Sep 7 15:49:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:49:06.689420 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-49d2b9ba-4a14-42b5-8740-b7a15d18b183 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "id": "1", "ram": 512, "name": "m1.tiny", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "swap": 0}} {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:49:06.708220 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-49d2b9ba-4a14-42b5-8740-b7a15d18b183 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.409078 Sep 07 15:49:06.708907 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 11/22] 10.222.0.17 () {64 vars in 1283 bytes} [Wed Sep 7 15:49:06 2022] POST /compute/v2.1/flavors => generated 402 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 15:49:06.720828 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-d59e975a-a7b5-4b23-bd2f-4eee15dfd6f7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:49:06.745020 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-d59e975a-a7b5-4b23-bd2f-4eee15dfd6f7 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027764 Sep 07 15:49:06.745591 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 12/23] 10.222.0.17 () {64 vars in 1333 bytes} [Wed Sep 7 15:49:06 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:49:09.357020 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-49d2b9ba-4a14-42b5-8740-b7a15d18b183 admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:49:09.358054 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-49d2b9ba-4a14-42b5-8740-b7a15d18b183 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Sep 07 15:49:09.358486 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 12/24] 10.222.0.17 () {54 vars in 931 bytes} [Wed Sep 7 15:49:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 15:49:09.757821 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-5f2252bd-53c8-47a2-9e38-3f6b871c7be7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "name": "m1.small", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "ram": 2048}} {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:49:09.778271 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-5f2252bd-53c8-47a2-9e38-3f6b871c7be7 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.412709 Sep 07 15:49:09.778843 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 13/25] 10.222.0.17 () {64 vars in 1283 bytes} [Wed Sep 7 15:49:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 15:49:09.790698 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-f04a89a2-4aa6-43f2-bfc9-6509c5d5e53e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:49:09.814587 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-f04a89a2-4aa6-43f2-bfc9-6509c5d5e53e admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027469 Sep 07 15:49:09.815601 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 13/26] 10.222.0.17 () {64 vars in 1333 bytes} [Wed Sep 7 15:49:09 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:49:12.497266 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-5f2252bd-53c8-47a2-9e38-3f6b871c7be7 admin admin] Calling method '>' {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:49:12.498965 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-5f2252bd-53c8-47a2-9e38-3f6b871c7be7 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002134 Sep 07 15:49:12.499844 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 14/27] 10.222.0.17 () {54 vars in 931 bytes} [Wed Sep 7 15:49:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:49:12.943565 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-8979e813-90fa-4e75-99dd-4f735b46b4d7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 4096, "name": "m1.medium", "os-flavor-access:is_public": true, "vcpus": 2, "rxtx_factor": 1.0, "disk": 40}} {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:49:12.964204 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-8979e813-90fa-4e75-99dd-4f735b46b4d7 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.458471 Sep 07 15:49:12.965112 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 14/28] 10.222.0.17 () {64 vars in 1283 bytes} [Wed Sep 7 15:49:12 2022] POST /compute/v2.1/flavors => generated 406 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 15:49:12.979488 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-3fec630f-228f-46c8-a56d-71ebae1d76a6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:49:13.006623 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-3fec630f-228f-46c8-a56d-71ebae1d76a6 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030996 Sep 07 15:49:13.007512 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 15/29] 10.222.0.17 () {64 vars in 1333 bytes} [Wed Sep 7 15:49:12 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:49:15.768726 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-8979e813-90fa-4e75-99dd-4f735b46b4d7 admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:49:15.769808 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-8979e813-90fa-4e75-99dd-4f735b46b4d7 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Sep 07 15:49:15.770279 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 15/30] 10.222.0.17 () {54 vars in 931 bytes} [Wed Sep 7 15:49:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:49:16.197750 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-2091640a-0647-46fe-968b-327e8bb032ac admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "disk": 80, "name": "m1.large"}} {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:49:16.206397 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG dbcounter [-] [105478] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:49:16.222345 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-2091640a-0647-46fe-968b-327e8bb032ac admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.445852 Sep 07 15:49:16.223444 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 16/31] 10.222.0.17 () {64 vars in 1283 bytes} [Wed Sep 7 15:49:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 15:49:16.236072 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-d44cd6aa-0b7e-4db5-ae4a-3e2be33cf959 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:49:16.264043 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-d44cd6aa-0b7e-4db5-ae4a-3e2be33cf959 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031666 Sep 07 15:49:16.264883 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 16/32] 10.222.0.17 () {64 vars in 1333 bytes} [Wed Sep 7 15:49:16 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:49:18.858466 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-2091640a-0647-46fe-968b-327e8bb032ac admin admin] Calling method '>' {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:49:18.859493 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-2091640a-0647-46fe-968b-327e8bb032ac admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Sep 07 15:49:18.859971 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 17/33] 10.222.0.17 () {54 vars in 931 bytes} [Wed Sep 7 15:49:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:49:19.419476 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-fa792597-9dfd-4ace-bb55-922518508169 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "id": "5", "name": "m1.xlarge", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "disk": 160, "ram": 16384}} {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:49:19.425081 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG dbcounter [-] [105477] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:49:19.443890 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-fa792597-9dfd-4ace-bb55-922518508169 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.577766 Sep 07 15:49:19.447593 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 17/34] 10.222.0.17 () {64 vars in 1283 bytes} [Wed Sep 7 15:49:18 2022] POST /compute/v2.1/flavors => generated 408 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 15:49:19.457044 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-7d1acedc-4c5c-4d48-887a-d80800bec751 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:49:19.486504 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-7d1acedc-4c5c-4d48-887a-d80800bec751 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033150 Sep 07 15:49:19.487317 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 18/35] 10.222.0.17 () {64 vars in 1333 bytes} [Wed Sep 7 15:49:19 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:49:36.376640 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-fa792597-9dfd-4ace-bb55-922518508169 admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:49:36.377571 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-fa792597-9dfd-4ace-bb55-922518508169 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Sep 07 15:49:36.377977 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 18/36] 10.222.0.17 () {54 vars in 931 bytes} [Wed Sep 7 15:49:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:49:36.388923 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG dbcounter [-] [105478] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:49:36.767629 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-c6f07386-c777-468b-8afc-548effafe005 admin admin] Calling method '>' {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:49:36.785340 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-c6f07386-c777-468b-8afc-548effafe005 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.401441 Sep 07 15:49:36.785862 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 19/37] 10.222.0.17 () {60 vars in 1292 bytes} [Wed Sep 7 15:49:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:49:38.091007 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-fa792597-9dfd-4ace-bb55-922518508169 admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:49:38.092073 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-fa792597-9dfd-4ace-bb55-922518508169 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Sep 07 15:49:38.092477 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 19/38] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Sep 7 15:49:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:49:38.615855 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-89a7482f-d0ef-44cc-9a7c-17bdedfb738b admin admin] Calling method '>' {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:49:38.622069 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.wsgi [None req-89a7482f-d0ef-44cc-9a7c-17bdedfb738b admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 07 15:49:38.625313 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-89a7482f-d0ef-44cc-9a7c-17bdedfb738b admin admin] Request method failure captured: Sep 07 15:49:38.625313 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 07 15:49:38.625313 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: Accept: application/json Sep 07 15:49:38.625313 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: Accept-Encoding: gzip, deflate Sep 07 15:49:38.625313 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: Connection: keep-alive Sep 07 15:49:38.625313 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: Content-Length: 0 Sep 07 15:49:38.625313 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: Host: 10.222.0.17 Sep 07 15:49:38.625313 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: Openstack-Api-Version: compute 2.92 Sep 07 15:49:38.625313 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: Openstack-System-Scope: None Sep 07 15:49:38.625313 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: User-Agent: python-novaclient Sep 07 15:49:38.625313 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-Auth-Token: gAAAAABjGL2RriX5Z0p7tThiCvhRCCw2bMUAE-2I1Wed73dP6hgPT0fVKGGSIrtwnh-m1YrEkDGGBYDyIq-v8J_U7T8CWS_YFJmSyD61VpyPflDzcCxnwavr5YA0SYMkNTzGhdSagqLf8uG_ptRgPzGAbU99A4aV62XkHlq-_v6x_fNmyno1XBk Sep 07 15:49:38.625313 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-Domain-Id: None Sep 07 15:49:38.625313 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-Domain-Name: None Sep 07 15:49:38.625313 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-Identity-Status: Confirmed Sep 07 15:49:38.625313 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-Is-Admin-Project: True Sep 07 15:49:38.625313 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 15:49:38.625313 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-Project-Domain-Id: default Sep 07 15:49:38.625313 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-Project-Domain-Name: Default Sep 07 15:49:38.625313 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-Project-Id: 4102cbba3e844357b14c2a5139b42e69 Sep 07 15:49:38.625313 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-Project-Name: admin Sep 07 15:49:38.625313 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-Role: reader,admin,member Sep 07 15:49:38.625313 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-Roles: reader,admin,member Sep 07 15:49:38.626869 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4102cbba3e844357b14c2a5139b42e69", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4102cbba3e844357b14c2a5139b42e69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4102cbba3e844357b14c2a5139b42e69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4102cbba3e844357b14c2a5139b42e69"}]}] Sep 07 15:49:38.626869 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-Tenant: admin Sep 07 15:49:38.626869 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-Tenant-Id: 4102cbba3e844357b14c2a5139b42e69 Sep 07 15:49:38.626869 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-Tenant-Name: admin Sep 07 15:49:38.626869 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-User: admin Sep 07 15:49:38.626869 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-User-Domain-Id: default Sep 07 15:49:38.626869 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-User-Domain-Name: Default Sep 07 15:49:38.626869 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-User-Id: 91fe14f693174ef291042aa145475ad4 Sep 07 15:49:38.626869 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-User-Name: admin Sep 07 15:49:38.626869 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: method: > Sep 07 15:49:38.626869 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: exception: Flavor 42 could not be found. Sep 07 15:49:38.626869 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: action_args: {'id': '42'} Sep 07 15:49:38.626869 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 15:49:38.626869 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:49:38.628029 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 15:49:38.628029 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 15:49:38.628029 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 15:49:38.628029 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 15:49:38.628029 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 15:49:38.628029 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 15:49:38.628029 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 15:49:38.628029 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 15:49:38.628029 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 15:49:38.628029 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 15:49:38.628029 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 15:49:38.628029 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 15:49:38.628029 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 07 15:49:38.628029 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi Sep 07 15:49:38.628029 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 15:49:38.628029 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi Sep 07 15:49:38.628029 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:49:38.628029 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 15:49:38.628029 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 15:49:38.629526 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 15:49:38.629526 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 15:49:38.629526 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 15:49:38.629526 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 15:49:38.629526 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 15:49:38.629526 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 15:49:38.629526 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 07 15:49:38.629526 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi Sep 07 15:49:38.629526 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 15:49:38.629526 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi Sep 07 15:49:38.629526 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:49:38.629526 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 15:49:38.629526 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 15:49:38.629526 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 15:49:38.629526 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 15:49:38.629526 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 07 15:49:38.629526 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi Sep 07 15:49:38.629526 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-89a7482f-d0ef-44cc-9a7c-17bdedfb738b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 15:49:38.630853 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-89a7482f-d0ef-44cc-9a7c-17bdedfb738b admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.397666 Sep 07 15:49:38.630853 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 20/39] 10.222.0.17 () {60 vars in 1190 bytes} [Wed Sep 7 15:49:38 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 07 15:49:38.637430 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-fd60f7fb-4a64-4424-a222-86a6ad0edb5a admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:49:38.659483 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-fd60f7fb-4a64-4424-a222-86a6ad0edb5a admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026512 Sep 07 15:49:38.660046 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 20/40] 10.222.0.17 () {60 vars in 1210 bytes} [Wed Sep 7 15:49:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:49:38.669477 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-67df2b9d-055a-4a9c-bdbb-c95b6ce78c67 admin admin] Calling method '>' {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:49:38.692311 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-67df2b9d-055a-4a9c-bdbb-c95b6ce78c67 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026282 Sep 07 15:49:38.692760 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 21/41] 10.222.0.17 () {60 vars in 1210 bytes} [Wed Sep 7 15:49:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:49:38.702535 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-7277b7b1-464c-4424-a93b-162831fae2df admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:49:38.708084 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.wsgi [None req-7277b7b1-464c-4424-a93b-162831fae2df admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 07 15:49:38.711269 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-7277b7b1-464c-4424-a93b-162831fae2df admin admin] Request method failure captured: Sep 07 15:49:38.711269 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 07 15:49:38.711269 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: Accept: application/json Sep 07 15:49:38.711269 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: Accept-Encoding: gzip, deflate Sep 07 15:49:38.711269 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: Connection: keep-alive Sep 07 15:49:38.711269 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: Content-Length: 0 Sep 07 15:49:38.711269 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: Host: 10.222.0.17 Sep 07 15:49:38.711269 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: Openstack-Api-Version: compute 2.92 Sep 07 15:49:38.711269 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: Openstack-System-Scope: None Sep 07 15:49:38.711269 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: User-Agent: python-novaclient Sep 07 15:49:38.711269 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-Auth-Token: gAAAAABjGL2RriX5Z0p7tThiCvhRCCw2bMUAE-2I1Wed73dP6hgPT0fVKGGSIrtwnh-m1YrEkDGGBYDyIq-v8J_U7T8CWS_YFJmSyD61VpyPflDzcCxnwavr5YA0SYMkNTzGhdSagqLf8uG_ptRgPzGAbU99A4aV62XkHlq-_v6x_fNmyno1XBk Sep 07 15:49:38.711269 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-Domain-Id: None Sep 07 15:49:38.711269 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-Domain-Name: None Sep 07 15:49:38.711269 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-Identity-Status: Confirmed Sep 07 15:49:38.711269 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-Is-Admin-Project: True Sep 07 15:49:38.711269 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 15:49:38.711269 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-Project-Domain-Id: default Sep 07 15:49:38.711269 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-Project-Domain-Name: Default Sep 07 15:49:38.711269 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-Project-Id: 4102cbba3e844357b14c2a5139b42e69 Sep 07 15:49:38.711269 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-Project-Name: admin Sep 07 15:49:38.711269 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-Role: reader,admin,member Sep 07 15:49:38.711269 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-Roles: reader,admin,member Sep 07 15:49:38.712865 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4102cbba3e844357b14c2a5139b42e69", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4102cbba3e844357b14c2a5139b42e69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4102cbba3e844357b14c2a5139b42e69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4102cbba3e844357b14c2a5139b42e69"}]}] Sep 07 15:49:38.712865 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-Tenant: admin Sep 07 15:49:38.712865 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-Tenant-Id: 4102cbba3e844357b14c2a5139b42e69 Sep 07 15:49:38.712865 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-Tenant-Name: admin Sep 07 15:49:38.712865 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-User: admin Sep 07 15:49:38.712865 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-User-Domain-Id: default Sep 07 15:49:38.712865 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-User-Domain-Name: Default Sep 07 15:49:38.712865 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-User-Id: 91fe14f693174ef291042aa145475ad4 Sep 07 15:49:38.712865 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-User-Name: admin Sep 07 15:49:38.712865 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: method: > Sep 07 15:49:38.712865 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: exception: Flavor 42 could not be found. Sep 07 15:49:38.712865 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: action_args: {'id': '42'} Sep 07 15:49:38.712865 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 15:49:38.712865 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:49:38.713914 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 15:49:38.713914 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 15:49:38.713914 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 15:49:38.713914 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 15:49:38.713914 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 15:49:38.713914 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 15:49:38.713914 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 15:49:38.713914 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 15:49:38.713914 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 15:49:38.713914 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 15:49:38.713914 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 15:49:38.713914 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 15:49:38.713914 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 07 15:49:38.713914 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Sep 07 15:49:38.713914 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 15:49:38.713914 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Sep 07 15:49:38.713914 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:49:38.713914 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 15:49:38.713914 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 15:49:38.715239 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 15:49:38.715239 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 15:49:38.715239 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 15:49:38.715239 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 15:49:38.715239 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 15:49:38.715239 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 15:49:38.715239 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 07 15:49:38.715239 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Sep 07 15:49:38.715239 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 15:49:38.715239 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Sep 07 15:49:38.715239 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:49:38.715239 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 15:49:38.715239 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 15:49:38.715239 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 15:49:38.715239 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 15:49:38.715239 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 07 15:49:38.715239 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Sep 07 15:49:38.715239 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-7277b7b1-464c-4424-a93b-162831fae2df admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 15:49:38.716477 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-7277b7b1-464c-4424-a93b-162831fae2df admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014273 Sep 07 15:49:38.716477 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 21/42] 10.222.0.17 () {60 vars in 1190 bytes} [Wed Sep 7 15:49:38 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 07 15:49:39.935688 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-67df2b9d-055a-4a9c-bdbb-c95b6ce78c67 admin admin] Calling method '>' {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:49:39.936703 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-67df2b9d-055a-4a9c-bdbb-c95b6ce78c67 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Sep 07 15:49:39.937137 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 22/43] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Sep 7 15:49:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:49:40.451420 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-b8fdf701-ef3f-43c0-9293-fd556e67422d admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:49:40.456832 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.wsgi [None req-b8fdf701-ef3f-43c0-9293-fd556e67422d admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 07 15:49:40.458320 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-b8fdf701-ef3f-43c0-9293-fd556e67422d admin admin] Request method failure captured: Sep 07 15:49:40.458320 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 07 15:49:40.458320 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: Accept: application/json Sep 07 15:49:40.458320 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: Accept-Encoding: gzip, deflate Sep 07 15:49:40.458320 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: Connection: keep-alive Sep 07 15:49:40.458320 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: Content-Length: 0 Sep 07 15:49:40.458320 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: Host: 10.222.0.17 Sep 07 15:49:40.458320 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: Openstack-Api-Version: compute 2.92 Sep 07 15:49:40.458320 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: Openstack-System-Scope: None Sep 07 15:49:40.458320 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: User-Agent: python-novaclient Sep 07 15:49:40.458320 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-Auth-Token: gAAAAABjGL2TKLO3OpYJPo2GTwbnhXe9rrNwKUu8EZqmHnjkJsFhdg6w_Duh_7EoS-jzOfMDRLXZgnxc0-b1RM09E6_ziveDgwpGfXR0OWkCQbB-oPdfXCgHabkXcaMPj2QJZ-PMdaYmjeiJBc6tVWsQM2oJfdGiIzANbZCuAFpICw8lcqOAyaY Sep 07 15:49:40.458320 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-Domain-Id: None Sep 07 15:49:40.458320 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-Domain-Name: None Sep 07 15:49:40.458320 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-Identity-Status: Confirmed Sep 07 15:49:40.458320 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-Is-Admin-Project: True Sep 07 15:49:40.458320 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 15:49:40.458320 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-Project-Domain-Id: default Sep 07 15:49:40.458320 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-Project-Domain-Name: Default Sep 07 15:49:40.458320 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-Project-Id: 4102cbba3e844357b14c2a5139b42e69 Sep 07 15:49:40.458320 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-Project-Name: admin Sep 07 15:49:40.458320 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-Role: reader,admin,member Sep 07 15:49:40.458320 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-Roles: reader,admin,member Sep 07 15:49:40.459920 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4102cbba3e844357b14c2a5139b42e69", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4102cbba3e844357b14c2a5139b42e69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4102cbba3e844357b14c2a5139b42e69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4102cbba3e844357b14c2a5139b42e69"}]}] Sep 07 15:49:40.459920 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-Tenant: admin Sep 07 15:49:40.459920 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-Tenant-Id: 4102cbba3e844357b14c2a5139b42e69 Sep 07 15:49:40.459920 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-Tenant-Name: admin Sep 07 15:49:40.459920 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-User: admin Sep 07 15:49:40.459920 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-User-Domain-Id: default Sep 07 15:49:40.459920 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-User-Domain-Name: Default Sep 07 15:49:40.459920 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-User-Id: 91fe14f693174ef291042aa145475ad4 Sep 07 15:49:40.459920 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-User-Name: admin Sep 07 15:49:40.459920 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: method: > Sep 07 15:49:40.459920 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: exception: Flavor 84 could not be found. Sep 07 15:49:40.459920 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: action_args: {'id': '84'} Sep 07 15:49:40.459920 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 15:49:40.459920 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:49:40.460855 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 15:49:40.460855 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 15:49:40.460855 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 15:49:40.460855 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 15:49:40.460855 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 15:49:40.460855 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 15:49:40.460855 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 15:49:40.460855 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 15:49:40.460855 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 15:49:40.460855 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 15:49:40.460855 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 15:49:40.460855 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 15:49:40.460855 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 07 15:49:40.460855 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Sep 07 15:49:40.460855 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 15:49:40.460855 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Sep 07 15:49:40.460855 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:49:40.460855 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 15:49:40.460855 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 15:49:40.462117 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 15:49:40.462117 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 15:49:40.462117 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 15:49:40.462117 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 15:49:40.462117 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 15:49:40.462117 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 15:49:40.462117 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 07 15:49:40.462117 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Sep 07 15:49:40.462117 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 15:49:40.462117 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Sep 07 15:49:40.462117 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:49:40.462117 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 15:49:40.462117 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 15:49:40.462117 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 15:49:40.462117 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 15:49:40.462117 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 07 15:49:40.462117 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Sep 07 15:49:40.462117 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-b8fdf701-ef3f-43c0-9293-fd556e67422d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 15:49:40.463196 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-b8fdf701-ef3f-43c0-9293-fd556e67422d admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.386768 Sep 07 15:49:40.463196 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 22/44] 10.222.0.17 () {60 vars in 1190 bytes} [Wed Sep 7 15:49:40 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 388 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 07 15:49:40.470106 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-fbe5147c-2437-4f03-932a-4ddc2fcf0857 admin admin] Calling method '>' {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:49:40.484990 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-fbe5147c-2437-4f03-932a-4ddc2fcf0857 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018423 Sep 07 15:49:40.485504 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 23/45] 10.222.0.17 () {60 vars in 1210 bytes} [Wed Sep 7 15:49:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:49:40.494770 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-387c3df6-73f7-4833-9157-aa0eb0433041 admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:49:40.509652 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-387c3df6-73f7-4833-9157-aa0eb0433041 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018418 Sep 07 15:49:40.510172 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 23/46] 10.222.0.17 () {60 vars in 1210 bytes} [Wed Sep 7 15:49:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 15:49:40.519890 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-89125df9-2bae-4338-8fb1-bfe564c3e609 admin admin] Calling method '>' {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:49:40.525150 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.wsgi [None req-89125df9-2bae-4338-8fb1-bfe564c3e609 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 07 15:49:40.527258 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-89125df9-2bae-4338-8fb1-bfe564c3e609 admin admin] Request method failure captured: Sep 07 15:49:40.527258 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 07 15:49:40.527258 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: Accept: application/json Sep 07 15:49:40.527258 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: Accept-Encoding: gzip, deflate Sep 07 15:49:40.527258 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: Connection: keep-alive Sep 07 15:49:40.527258 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: Content-Length: 0 Sep 07 15:49:40.527258 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: Host: 10.222.0.17 Sep 07 15:49:40.527258 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: Openstack-Api-Version: compute 2.92 Sep 07 15:49:40.527258 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: Openstack-System-Scope: None Sep 07 15:49:40.527258 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: User-Agent: python-novaclient Sep 07 15:49:40.527258 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-Auth-Token: gAAAAABjGL2TKLO3OpYJPo2GTwbnhXe9rrNwKUu8EZqmHnjkJsFhdg6w_Duh_7EoS-jzOfMDRLXZgnxc0-b1RM09E6_ziveDgwpGfXR0OWkCQbB-oPdfXCgHabkXcaMPj2QJZ-PMdaYmjeiJBc6tVWsQM2oJfdGiIzANbZCuAFpICw8lcqOAyaY Sep 07 15:49:40.527258 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-Domain-Id: None Sep 07 15:49:40.527258 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-Domain-Name: None Sep 07 15:49:40.527258 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-Identity-Status: Confirmed Sep 07 15:49:40.527258 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-Is-Admin-Project: True Sep 07 15:49:40.527258 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 15:49:40.527258 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-Project-Domain-Id: default Sep 07 15:49:40.527258 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-Project-Domain-Name: Default Sep 07 15:49:40.527258 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-Project-Id: 4102cbba3e844357b14c2a5139b42e69 Sep 07 15:49:40.527258 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-Project-Name: admin Sep 07 15:49:40.527258 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-Role: reader,admin,member Sep 07 15:49:40.527258 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-Roles: reader,admin,member Sep 07 15:49:40.528804 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4102cbba3e844357b14c2a5139b42e69", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4102cbba3e844357b14c2a5139b42e69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4102cbba3e844357b14c2a5139b42e69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4102cbba3e844357b14c2a5139b42e69"}]}] Sep 07 15:49:40.528804 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-Tenant: admin Sep 07 15:49:40.528804 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-Tenant-Id: 4102cbba3e844357b14c2a5139b42e69 Sep 07 15:49:40.528804 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-Tenant-Name: admin Sep 07 15:49:40.528804 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-User: admin Sep 07 15:49:40.528804 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-User-Domain-Id: default Sep 07 15:49:40.528804 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-User-Domain-Name: Default Sep 07 15:49:40.528804 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-User-Id: 91fe14f693174ef291042aa145475ad4 Sep 07 15:49:40.528804 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-User-Name: admin Sep 07 15:49:40.528804 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: method: > Sep 07 15:49:40.528804 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: exception: Flavor 84 could not be found. Sep 07 15:49:40.528804 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: action_args: {'id': '84'} Sep 07 15:49:40.528804 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 15:49:40.528804 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:49:40.529620 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 15:49:40.529620 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 15:49:40.529620 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 15:49:40.529620 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 15:49:40.529620 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 15:49:40.529620 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 15:49:40.529620 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 15:49:40.529620 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 15:49:40.529620 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 15:49:40.529620 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 15:49:40.529620 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 15:49:40.529620 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 15:49:40.529620 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 07 15:49:40.529620 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi Sep 07 15:49:40.529620 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 15:49:40.529620 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi Sep 07 15:49:40.529620 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:49:40.529620 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 15:49:40.529620 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 15:49:40.530800 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 15:49:40.530800 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 15:49:40.530800 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 15:49:40.530800 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 15:49:40.530800 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 15:49:40.530800 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 15:49:40.530800 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 07 15:49:40.530800 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi Sep 07 15:49:40.530800 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 15:49:40.530800 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi Sep 07 15:49:40.530800 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:49:40.530800 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 15:49:40.530800 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 15:49:40.530800 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 15:49:40.530800 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 15:49:40.530800 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 07 15:49:40.530800 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi Sep 07 15:49:40.530800 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-89125df9-2bae-4338-8fb1-bfe564c3e609 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 15:49:40.531851 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-89125df9-2bae-4338-8fb1-bfe564c3e609 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012353 Sep 07 15:49:40.531851 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 24/47] 10.222.0.17 () {60 vars in 1190 bytes} [Wed Sep 7 15:49:40 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 07 15:49:41.736568 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-387c3df6-73f7-4833-9157-aa0eb0433041 admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:49:41.737605 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-387c3df6-73f7-4833-9157-aa0eb0433041 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Sep 07 15:49:41.737994 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 24/48] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Sep 7 15:49:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:49:42.256455 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-a4f2dfbe-b167-4856-b87e-1aa9d38f6880 admin admin] Calling method '>' {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:49:42.262215 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.wsgi [None req-a4f2dfbe-b167-4856-b87e-1aa9d38f6880 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 07 15:49:42.263740 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-a4f2dfbe-b167-4856-b87e-1aa9d38f6880 admin admin] Request method failure captured: Sep 07 15:49:42.263740 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 07 15:49:42.263740 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: Accept: application/json Sep 07 15:49:42.263740 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: Accept-Encoding: gzip, deflate Sep 07 15:49:42.263740 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: Connection: keep-alive Sep 07 15:49:42.263740 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: Content-Length: 0 Sep 07 15:49:42.263740 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: Host: 10.222.0.17 Sep 07 15:49:42.263740 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: Openstack-Api-Version: compute 2.92 Sep 07 15:49:42.263740 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: Openstack-System-Scope: None Sep 07 15:49:42.263740 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: User-Agent: python-novaclient Sep 07 15:49:42.263740 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-Auth-Token: gAAAAABjGL2VCzS59TKgowNdzj67cD5XfBIOF_8GcGHaP0KPprcgB3spVbk-BbJLZPsMIU50Cw2w-jwXiBN8bosCxPiyletnlg1cwqWvOEq3klTezKQGi5wVhV6CJQGCqvNbcR72O6801UlMFmXOOunP1RF5XS3COZkTPmv_jZ3ljy9CZwYU-Fk Sep 07 15:49:42.263740 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-Domain-Id: None Sep 07 15:49:42.263740 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-Domain-Name: None Sep 07 15:49:42.263740 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-Identity-Status: Confirmed Sep 07 15:49:42.263740 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-Is-Admin-Project: True Sep 07 15:49:42.263740 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 15:49:42.263740 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-Project-Domain-Id: default Sep 07 15:49:42.263740 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-Project-Domain-Name: Default Sep 07 15:49:42.263740 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-Project-Id: 4102cbba3e844357b14c2a5139b42e69 Sep 07 15:49:42.263740 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-Project-Name: admin Sep 07 15:49:42.263740 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-Role: reader,admin,member Sep 07 15:49:42.263740 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-Roles: reader,admin,member Sep 07 15:49:42.265286 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4102cbba3e844357b14c2a5139b42e69", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4102cbba3e844357b14c2a5139b42e69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4102cbba3e844357b14c2a5139b42e69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4102cbba3e844357b14c2a5139b42e69"}]}] Sep 07 15:49:42.265286 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-Tenant: admin Sep 07 15:49:42.265286 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-Tenant-Id: 4102cbba3e844357b14c2a5139b42e69 Sep 07 15:49:42.265286 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-Tenant-Name: admin Sep 07 15:49:42.265286 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-User: admin Sep 07 15:49:42.265286 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-User-Domain-Id: default Sep 07 15:49:42.265286 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-User-Domain-Name: Default Sep 07 15:49:42.265286 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-User-Id: 91fe14f693174ef291042aa145475ad4 Sep 07 15:49:42.265286 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: X-User-Name: admin Sep 07 15:49:42.265286 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: method: > Sep 07 15:49:42.265286 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: exception: Flavor 451 could not be found. Sep 07 15:49:42.265286 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: action_args: {'id': '451'} Sep 07 15:49:42.265286 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 15:49:42.265286 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:49:42.266279 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 15:49:42.266279 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 15:49:42.266279 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 15:49:42.266279 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 15:49:42.266279 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 15:49:42.266279 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 15:49:42.266279 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 15:49:42.266279 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 15:49:42.266279 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 15:49:42.266279 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 15:49:42.266279 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 15:49:42.266279 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 15:49:42.266279 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 07 15:49:42.266279 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi Sep 07 15:49:42.266279 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 15:49:42.266279 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi Sep 07 15:49:42.266279 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:49:42.266279 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 15:49:42.266279 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 15:49:42.267669 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 15:49:42.267669 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 15:49:42.267669 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 15:49:42.267669 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 15:49:42.267669 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 15:49:42.267669 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 15:49:42.267669 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 07 15:49:42.267669 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi Sep 07 15:49:42.267669 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 15:49:42.267669 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi Sep 07 15:49:42.267669 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:49:42.267669 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 15:49:42.267669 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 15:49:42.267669 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 15:49:42.267669 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 15:49:42.267669 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 07 15:49:42.267669 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: ERROR nova.api.openstack.wsgi Sep 07 15:49:42.267669 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-a4f2dfbe-b167-4856-b87e-1aa9d38f6880 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 15:49:42.269015 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-a4f2dfbe-b167-4856-b87e-1aa9d38f6880 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.388931 Sep 07 15:49:42.269015 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 25/49] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Sep 7 15:49:41 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 07 15:49:42.274782 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-3cda57df-8236-47a2-b72a-04bd1bb010c6 admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:49:42.290120 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-3cda57df-8236-47a2-b72a-04bd1bb010c6 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018955 Sep 07 15:49:42.290642 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 25/50] 10.222.0.17 () {60 vars in 1210 bytes} [Wed Sep 7 15:49:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:49:42.300335 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-ca7e0a36-32d8-4cda-8a82-df47fb40032a admin admin] Calling method '>' {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:49:42.315066 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-ca7e0a36-32d8-4cda-8a82-df47fb40032a admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018225 Sep 07 15:49:42.315606 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 26/51] 10.222.0.17 () {60 vars in 1210 bytes} [Wed Sep 7 15:49:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:49:42.324470 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-eab41ed6-e032-4939-8973-3620fbaeaf74 admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:49:42.329687 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.wsgi [None req-eab41ed6-e032-4939-8973-3620fbaeaf74 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 07 15:49:42.331163 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-eab41ed6-e032-4939-8973-3620fbaeaf74 admin admin] Request method failure captured: Sep 07 15:49:42.331163 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 07 15:49:42.331163 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: Accept: application/json Sep 07 15:49:42.331163 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: Accept-Encoding: gzip, deflate Sep 07 15:49:42.331163 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: Connection: keep-alive Sep 07 15:49:42.331163 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: Content-Length: 0 Sep 07 15:49:42.331163 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: Host: 10.222.0.17 Sep 07 15:49:42.331163 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: Openstack-Api-Version: compute 2.92 Sep 07 15:49:42.331163 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: Openstack-System-Scope: None Sep 07 15:49:42.331163 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: User-Agent: python-novaclient Sep 07 15:49:42.331163 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-Auth-Token: gAAAAABjGL2VCzS59TKgowNdzj67cD5XfBIOF_8GcGHaP0KPprcgB3spVbk-BbJLZPsMIU50Cw2w-jwXiBN8bosCxPiyletnlg1cwqWvOEq3klTezKQGi5wVhV6CJQGCqvNbcR72O6801UlMFmXOOunP1RF5XS3COZkTPmv_jZ3ljy9CZwYU-Fk Sep 07 15:49:42.331163 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-Domain-Id: None Sep 07 15:49:42.331163 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-Domain-Name: None Sep 07 15:49:42.331163 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-Identity-Status: Confirmed Sep 07 15:49:42.331163 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-Is-Admin-Project: True Sep 07 15:49:42.331163 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 15:49:42.331163 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-Project-Domain-Id: default Sep 07 15:49:42.331163 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-Project-Domain-Name: Default Sep 07 15:49:42.331163 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-Project-Id: 4102cbba3e844357b14c2a5139b42e69 Sep 07 15:49:42.331163 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-Project-Name: admin Sep 07 15:49:42.331163 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-Role: reader,admin,member Sep 07 15:49:42.331163 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-Roles: reader,admin,member Sep 07 15:49:42.332734 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4102cbba3e844357b14c2a5139b42e69", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4102cbba3e844357b14c2a5139b42e69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4102cbba3e844357b14c2a5139b42e69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4102cbba3e844357b14c2a5139b42e69"}]}] Sep 07 15:49:42.332734 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-Tenant: admin Sep 07 15:49:42.332734 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-Tenant-Id: 4102cbba3e844357b14c2a5139b42e69 Sep 07 15:49:42.332734 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-Tenant-Name: admin Sep 07 15:49:42.332734 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-User: admin Sep 07 15:49:42.332734 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-User-Domain-Id: default Sep 07 15:49:42.332734 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-User-Domain-Name: Default Sep 07 15:49:42.332734 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-User-Id: 91fe14f693174ef291042aa145475ad4 Sep 07 15:49:42.332734 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: X-User-Name: admin Sep 07 15:49:42.332734 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: method: > Sep 07 15:49:42.332734 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: exception: Flavor 451 could not be found. Sep 07 15:49:42.332734 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: action_args: {'id': '451'} Sep 07 15:49:42.332734 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 15:49:42.332734 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:49:42.333718 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 15:49:42.333718 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 15:49:42.333718 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 15:49:42.333718 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 15:49:42.333718 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 15:49:42.333718 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 15:49:42.333718 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 15:49:42.333718 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 15:49:42.333718 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 15:49:42.333718 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 15:49:42.333718 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 15:49:42.333718 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 15:49:42.333718 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 07 15:49:42.333718 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Sep 07 15:49:42.333718 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 15:49:42.333718 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Sep 07 15:49:42.333718 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:49:42.333718 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 15:49:42.333718 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 15:49:42.334801 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 15:49:42.334801 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 15:49:42.334801 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 15:49:42.334801 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 15:49:42.334801 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 15:49:42.334801 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 15:49:42.334801 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 07 15:49:42.334801 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Sep 07 15:49:42.334801 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 15:49:42.334801 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Sep 07 15:49:42.334801 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:49:42.334801 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 15:49:42.334801 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 15:49:42.334801 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 15:49:42.334801 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 15:49:42.334801 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 07 15:49:42.334801 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: ERROR nova.api.openstack.wsgi Sep 07 15:49:42.334801 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-eab41ed6-e032-4939-8973-3620fbaeaf74 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 15:49:42.335944 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-eab41ed6-e032-4939-8973-3620fbaeaf74 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011578 Sep 07 15:49:42.335944 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 26/52] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Sep 7 15:49:42 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 07 15:49:43.549917 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-ca7e0a36-32d8-4cda-8a82-df47fb40032a admin admin] Calling method '>' {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:49:43.550922 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-ca7e0a36-32d8-4cda-8a82-df47fb40032a admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Sep 07 15:49:43.551320 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 27/53] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Sep 7 15:49:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:49:44.076012 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-a81b22c7-3a0e-435e-a786-40ad4154789c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:49:44.094198 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-a81b22c7-3a0e-435e-a786-40ad4154789c admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.406119 Sep 07 15:49:44.094728 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 27/54] 10.222.0.17 () {64 vars in 1235 bytes} [Wed Sep 7 15:49:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 15:49:45.300003 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-ca7e0a36-32d8-4cda-8a82-df47fb40032a admin admin] Calling method '>' {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:49:45.301092 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-ca7e0a36-32d8-4cda-8a82-df47fb40032a admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001584 Sep 07 15:49:45.301485 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 28/55] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Sep 7 15:49:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:49:45.821748 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-55c1e674-3a24-4ec4-b037-f8d97c821641 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:49:45.839966 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-55c1e674-3a24-4ec4-b037-f8d97c821641 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.402200 Sep 07 15:49:45.840512 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 28/56] 10.222.0.17 () {64 vars in 1235 bytes} [Wed Sep 7 15:49:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 15:49:47.060074 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-ca7e0a36-32d8-4cda-8a82-df47fb40032a admin admin] Calling method '>' {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:49:47.061076 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-ca7e0a36-32d8-4cda-8a82-df47fb40032a admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Sep 07 15:49:47.061498 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 29/57] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Sep 7 15:49:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:49:47.577281 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-415150e1-25e1-449e-ad97-c6332c64b8e9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:49:47.596390 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-415150e1-25e1-449e-ad97-c6332c64b8e9 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.398680 Sep 07 15:49:47.596933 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 29/58] 10.222.0.17 () {64 vars in 1235 bytes} [Wed Sep 7 15:49:47 2022] POST /compute/v2.1/flavors => generated 407 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 15:49:48.809515 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-ca7e0a36-32d8-4cda-8a82-df47fb40032a admin admin] Calling method '>' {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:49:48.810548 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-ca7e0a36-32d8-4cda-8a82-df47fb40032a admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Sep 07 15:49:48.810943 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 30/59] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Sep 7 15:49:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:49:49.327100 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-36dc22af-66a4-436e-84d9-b572afee62b0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:49:49.345217 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-36dc22af-66a4-436e-84d9-b572afee62b0 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.398614 Sep 07 15:49:49.345769 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 30/60] 10.222.0.17 () {64 vars in 1235 bytes} [Wed Sep 7 15:49:48 2022] POST /compute/v2.1/flavors => generated 409 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 15:49:50.544922 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-ca7e0a36-32d8-4cda-8a82-df47fb40032a admin admin] Calling method '>' {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:49:50.545952 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-ca7e0a36-32d8-4cda-8a82-df47fb40032a admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Sep 07 15:49:50.546362 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 31/61] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Sep 7 15:49:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:49:51.059046 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-1b6ace67-7c10-42e4-9ae0-beec8c1648d7 admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:49:51.079206 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-1b6ace67-7c10-42e4-9ae0-beec8c1648d7 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.396695 Sep 07 15:49:51.079769 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 31/62] 10.222.0.17 () {60 vars in 1202 bytes} [Wed Sep 7 15:49:50 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:50:47.253782 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-ca7e0a36-32d8-4cda-8a82-df47fb40032a admin admin] Calling method '>' {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:50:47.254791 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-ca7e0a36-32d8-4cda-8a82-df47fb40032a admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Sep 07 15:50:47.255190 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 32/63] 10.222.0.17 () {54 vars in 931 bytes} [Wed Sep 7 15:50:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:50:47.266323 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG dbcounter [-] [105477] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:50:47.645123 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-66c27ab5-e028-4069-aa93-fc840ddbf72b admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:50:47.665969 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-66c27ab5-e028-4069-aa93-fc840ddbf72b admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.404177 Sep 07 15:50:47.666432 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 32/64] 10.222.0.17 () {60 vars in 1292 bytes} [Wed Sep 7 15:50:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:50:47.687410 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG dbcounter [-] [105478] Writing DB stats nova_api:SELECT=14 {{(pid=105478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:50:47.691095 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-c4d32999-d42a-464f-854d-2e65d0ea5f92 admin admin] Calling method '>' {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:50:47.698832 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-c4d32999-d42a-464f-854d-2e65d0ea5f92 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012922 Sep 07 15:50:47.699332 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 33/65] 10.222.0.17 () {60 vars in 1283 bytes} [Wed Sep 7 15:50:47 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:50:47.710713 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-1dc14823-1cfe-4cde-abdc-c8545f4ded5e admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:50:47.718307 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-1dc14823-1cfe-4cde-abdc-c8545f4ded5e admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011230 Sep 07 15:50:47.718818 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 33/66] 10.222.0.17 () {60 vars in 1286 bytes} [Wed Sep 7 15:50:47 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:50:47.730244 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-186fcb60-6ec8-4f67-8814-783446ef01da admin admin] Calling method '>' {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:50:47.737444 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-186fcb60-6ec8-4f67-8814-783446ef01da admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011137 Sep 07 15:50:47.737941 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 34/67] 10.222.0.17 () {60 vars in 1286 bytes} [Wed Sep 7 15:50:47 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:50:47.749507 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-75242cb3-56de-4c3a-bfb2-5225810f3153 admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:50:47.756971 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-75242cb3-56de-4c3a-bfb2-5225810f3153 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010940 Sep 07 15:50:47.757485 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 34/68] 10.222.0.17 () {60 vars in 1283 bytes} [Wed Sep 7 15:50:47 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:53:52.687518 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-186fcb60-6ec8-4f67-8814-783446ef01da admin admin] Calling method '>' {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:53:52.688561 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-186fcb60-6ec8-4f67-8814-783446ef01da admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Sep 07 15:53:52.689004 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 35/69] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Sep 7 15:53:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:53:52.826994 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG dbcounter [-] [105477] Writing DB stats nova_api:SELECT=6 {{(pid=105477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:53:52.985807 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-9e049ea2-fd8d-46d0-ad35-898340233a67 admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:53:52.989196 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG oslo_concurrency.lockutils [None req-9e049ea2-fd8d-46d0-ad35-898340233a67 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:53:52.989668 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG oslo_concurrency.lockutils [None req-9e049ea2-fd8d-46d0-ad35-898340233a67 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:53:52.990090 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG oslo_concurrency.lockutils [None req-9e049ea2-fd8d-46d0-ad35-898340233a67 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:53:52.990797 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG oslo_concurrency.lockutils [None req-9e049ea2-fd8d-46d0-ad35-898340233a67 admin admin] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:53:52.991238 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG oslo_concurrency.lockutils [None req-9e049ea2-fd8d-46d0-ad35-898340233a67 admin admin] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:53:52.991690 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG oslo_concurrency.lockutils [None req-9e049ea2-fd8d-46d0-ad35-898340233a67 admin admin] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:53:53.025303 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-9e049ea2-fd8d-46d0-ad35-898340233a67 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.199787 Sep 07 15:53:53.025857 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 35/70] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Sep 7 15:53:52 2022] GET /compute/v2.1/os-services => generated 791 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 15:53:54.109060 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-186fcb60-6ec8-4f67-8814-783446ef01da admin admin] Calling method '>' {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:53:54.110048 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-186fcb60-6ec8-4f67-8814-783446ef01da admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001398 Sep 07 15:53:54.110441 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 36/71] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Sep 7 15:53:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:53:54.298037 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-2639dacd-7d96-4d81-a5c4-86146bc119f8 admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:53:54.301424 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG oslo_concurrency.lockutils [None req-2639dacd-7d96-4d81-a5c4-86146bc119f8 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:53:54.301899 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG oslo_concurrency.lockutils [None req-2639dacd-7d96-4d81-a5c4-86146bc119f8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:53:54.302327 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG oslo_concurrency.lockutils [None req-2639dacd-7d96-4d81-a5c4-86146bc119f8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:53:54.303041 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG oslo_concurrency.lockutils [None req-2639dacd-7d96-4d81-a5c4-86146bc119f8 admin admin] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:53:54.303491 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG oslo_concurrency.lockutils [None req-2639dacd-7d96-4d81-a5c4-86146bc119f8 admin admin] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:53:54.303933 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG oslo_concurrency.lockutils [None req-2639dacd-7d96-4d81-a5c4-86146bc119f8 admin admin] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:53:54.323745 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-2639dacd-7d96-4d81-a5c4-86146bc119f8 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.076935 Sep 07 15:53:54.324232 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 36/72] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Sep 7 15:53:54 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 15:54:05.814079 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-186fcb60-6ec8-4f67-8814-783446ef01da admin admin] Calling method '>' {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:54:05.815087 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-186fcb60-6ec8-4f67-8814-783446ef01da admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Sep 07 15:54:05.815482 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 37/73] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Sep 7 15:54:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:54:05.959360 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG dbcounter [-] [105477] Writing DB stats nova_cell0:SELECT=4 {{(pid=105477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:54:05.960113 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG dbcounter [-] [105477] Writing DB stats nova_cell1:SELECT=4 {{(pid=105477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:54:05.960928 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG dbcounter [-] [105477] Writing DB stats nova_api:SELECT=8 {{(pid=105477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:54:06.008664 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-30650107-f2ec-4732-8dbe-7682d18f4b8e admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:54:06.012125 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG oslo_concurrency.lockutils [None req-30650107-f2ec-4732-8dbe-7682d18f4b8e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:54:06.012603 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG oslo_concurrency.lockutils [None req-30650107-f2ec-4732-8dbe-7682d18f4b8e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:54:06.013032 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG oslo_concurrency.lockutils [None req-30650107-f2ec-4732-8dbe-7682d18f4b8e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:54:06.013741 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG oslo_concurrency.lockutils [None req-30650107-f2ec-4732-8dbe-7682d18f4b8e admin admin] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:54:06.014184 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG oslo_concurrency.lockutils [None req-30650107-f2ec-4732-8dbe-7682d18f4b8e admin admin] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:54:06.014596 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG oslo_concurrency.lockutils [None req-30650107-f2ec-4732-8dbe-7682d18f4b8e admin admin] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:54:06.040832 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-30650107-f2ec-4732-8dbe-7682d18f4b8e admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.086612 Sep 07 15:54:06.041313 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 37/74] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Sep 7 15:54:05 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:54:07.116704 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: DEBUG nova.api.openstack.wsgi [None req-186fcb60-6ec8-4f67-8814-783446ef01da admin admin] Calling method '>' {{(pid=105478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:54:07.117718 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: INFO nova.api.openstack.requestlog [None req-186fcb60-6ec8-4f67-8814-783446ef01da admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Sep 07 15:54:07.118103 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: [pid: 105478|app: 0|req: 38/75] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Sep 7 15:54:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:54:07.313924 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG nova.api.openstack.wsgi [None req-9d9c4eed-23d0-4dbc-9e5e-9a79c83e108a admin admin] Calling method '>' {{(pid=105477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:54:07.317323 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG oslo_concurrency.lockutils [None req-9d9c4eed-23d0-4dbc-9e5e-9a79c83e108a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:54:07.317796 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG oslo_concurrency.lockutils [None req-9d9c4eed-23d0-4dbc-9e5e-9a79c83e108a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:54:07.318220 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG oslo_concurrency.lockutils [None req-9d9c4eed-23d0-4dbc-9e5e-9a79c83e108a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:54:07.318932 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG oslo_concurrency.lockutils [None req-9d9c4eed-23d0-4dbc-9e5e-9a79c83e108a admin admin] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:54:07.319376 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG oslo_concurrency.lockutils [None req-9d9c4eed-23d0-4dbc-9e5e-9a79c83e108a admin admin] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:54:07.319824 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: DEBUG oslo_concurrency.lockutils [None req-9d9c4eed-23d0-4dbc-9e5e-9a79c83e108a admin admin] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:54:07.341404 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: INFO nova.api.openstack.requestlog [None req-9d9c4eed-23d0-4dbc-9e5e-9a79c83e108a admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.082806 Sep 07 15:54:07.341887 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: [pid: 105477|app: 0|req: 38/76] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Sep 7 15:54:07 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:55:06.961300 dv-cinder-853315-8-iscsi devstack@n-api.service[105476]: Wed Sep 7 15:55:06 2022 - graceful shutdown triggered... Sep 07 15:55:06.961426 dv-cinder-853315-8-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 07 15:55:06.962276 dv-cinder-853315-8-iscsi devstack@n-api.service[105477]: Gracefully killing worker 1 (pid: 105477)... Sep 07 15:55:06.962669 dv-cinder-853315-8-iscsi devstack@n-api.service[105478]: Gracefully killing worker 2 (pid: 105478)... Sep 07 15:55:07.963378 dv-cinder-853315-8-iscsi devstack@n-api.service[105476]: worker 1 buried after 1 seconds Sep 07 15:55:07.963946 dv-cinder-853315-8-iscsi devstack@n-api.service[105476]: worker 2 buried after 1 seconds Sep 07 15:55:07.963946 dv-cinder-853315-8-iscsi devstack@n-api.service[105476]: goodbye to uWSGI. Sep 07 15:55:07.964954 dv-cinder-853315-8-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 07 15:55:07.965496 dv-cinder-853315-8-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 07 15:55:07.968302 dv-cinder-853315-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 07 15:55:07.978295 dv-cinder-853315-8-iscsi devstack@n-api.service[120625]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 07 15:55:07.980887 dv-cinder-853315-8-iscsi devstack@n-api.service[120625]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 7 15:55:07 2022] *** Sep 07 15:55:07.981033 dv-cinder-853315-8-iscsi devstack@n-api.service[120625]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 07 15:55:07.981285 dv-cinder-853315-8-iscsi devstack@n-api.service[120625]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 07 15:55:07.981285 dv-cinder-853315-8-iscsi devstack@n-api.service[120625]: nodename: dv-cinder-853315-8-iscsi Sep 07 15:55:07.981285 dv-cinder-853315-8-iscsi devstack@n-api.service[120625]: machine: x86_64 Sep 07 15:55:07.981285 dv-cinder-853315-8-iscsi devstack@n-api.service[120625]: clock source: unix Sep 07 15:55:07.981285 dv-cinder-853315-8-iscsi devstack@n-api.service[120625]: pcre jit disabled Sep 07 15:55:07.981285 dv-cinder-853315-8-iscsi devstack@n-api.service[120625]: detected number of CPU cores: 4 Sep 07 15:55:07.981285 dv-cinder-853315-8-iscsi devstack@n-api.service[120625]: current working directory: / Sep 07 15:55:07.981285 dv-cinder-853315-8-iscsi devstack@n-api.service[120625]: detected binary path: /usr/bin/uwsgi-core Sep 07 15:55:07.981285 dv-cinder-853315-8-iscsi devstack@n-api.service[120625]: your processes number limit is 47680 Sep 07 15:55:07.981285 dv-cinder-853315-8-iscsi devstack@n-api.service[120625]: your memory page size is 4096 bytes Sep 07 15:55:07.981285 dv-cinder-853315-8-iscsi devstack@n-api.service[120625]: detected max file descriptor number: 2048 Sep 07 15:55:07.982021 dv-cinder-853315-8-iscsi devstack@n-api.service[120625]: lock engine: pthread robust mutexes Sep 07 15:55:07.982021 dv-cinder-853315-8-iscsi devstack@n-api.service[120625]: thunder lock: enabled Sep 07 15:55:07.982021 dv-cinder-853315-8-iscsi devstack@n-api.service[120625]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 07 15:55:07.982021 dv-cinder-853315-8-iscsi devstack@n-api.service[120625]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 07 15:55:08.021327 dv-cinder-853315-8-iscsi devstack@n-api.service[120625]: Python main interpreter initialized at 0x55ca592809c0 Sep 07 15:55:08.021327 dv-cinder-853315-8-iscsi devstack@n-api.service[120625]: python threads support enabled Sep 07 15:55:08.021327 dv-cinder-853315-8-iscsi devstack@n-api.service[120625]: your server socket listen backlog is limited to 100 connections Sep 07 15:55:08.021327 dv-cinder-853315-8-iscsi devstack@n-api.service[120625]: your mercy for graceful operations on workers is 90 seconds Sep 07 15:55:08.021809 dv-cinder-853315-8-iscsi devstack@n-api.service[120625]: mapped 403077 bytes (393 KB) for 2 cores Sep 07 15:55:08.021809 dv-cinder-853315-8-iscsi devstack@n-api.service[120625]: *** Operational MODE: preforking *** Sep 07 15:55:08.022047 dv-cinder-853315-8-iscsi devstack@n-api.service[120625]: *** uWSGI is running in multiple interpreter mode *** Sep 07 15:55:08.022047 dv-cinder-853315-8-iscsi devstack@n-api.service[120625]: spawned uWSGI master process (pid: 120625) Sep 07 15:55:08.022255 dv-cinder-853315-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 07 15:55:08.022826 dv-cinder-853315-8-iscsi devstack@n-api.service[120625]: spawned uWSGI worker 1 (pid: 120640, cores: 1) Sep 07 15:55:08.023353 dv-cinder-853315-8-iscsi devstack@n-api.service[120625]: spawned uWSGI worker 2 (pid: 120641, cores: 1) Sep 07 15:55:08.023754 dv-cinder-853315-8-iscsi devstack@n-api.service[120625]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 07 15:55:08.689799 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 07 15:55:08.691415 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 07 15:55:09.854982 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 15:55:09.854982 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: from cryptography.utils import int_from_bytes Sep 07 15:55:09.855613 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 15:55:09.855613 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: from cryptography.utils import int_from_bytes Sep 07 15:55:09.856066 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 15:55:09.856066 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: from cryptography.utils import int_from_bytes Sep 07 15:55:09.856217 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 15:55:09.856217 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: from cryptography.utils import int_from_bytes Sep 07 15:55:12.264999 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 07 15:55:12.265766 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 07 15:55:12.265858 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 07 15:55:12.266156 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 07 15:55:12.266401 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 07 15:55:12.266792 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.267117 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.267440 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.267785 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.268116 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.268429 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.268750 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.269070 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.269400 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.270202 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.270521 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.270999 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853315-8-iscsi {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.271321 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.271654 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.271968 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.272289 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.272596 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.272918 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.273223 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.273732 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.275177 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.275177 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.275177 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.275448 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.275747 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.276050 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.276174 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 07 15:55:12.276544 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 07 15:55:12.276626 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.276698 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.276903 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 07 15:55:12.277133 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.277337 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 07 15:55:12.277579 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.277839 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 07 15:55:12.278058 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853315-8-iscsi {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.278284 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.278498 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.278789 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.279074 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.279293 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.279497 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.279762 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.279972 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.280192 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.280405 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.280630 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.280845 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.281058 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.281269 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.281480 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.281683 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.281871 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.282074 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.282265 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.282412 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.282552 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.282724 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.282874 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853315-8-iscsi {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.283035 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.283189 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.283362 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.283517 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.283687 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.283882 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.284046 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.284190 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.284338 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.284486 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.284661 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.284661 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.284959 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.285705 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.285866 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.286025 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.286190 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.287423 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.287600 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.287759 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.287903 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.288056 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.288206 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.288366 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.288366 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.288675 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.288824 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.288975 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.289131 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.289280 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.289430 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.289582 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.289730 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.290991 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.291785 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.291946 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.292102 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.292245 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.292386 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.292542 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853315-8-iscsi {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.292686 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.292834 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.293005 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.293501 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.293665 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.293665 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.294109 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.295974 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.296421 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.296616 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.296801 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.296970 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.297115 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.297266 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.297417 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.297559 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.297711 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.297865 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.298006 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.298161 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.298303 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.298454 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.298603 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.298751 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.298902 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.299062 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.299210 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.299361 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.299511 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.299727 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.299880 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.300054 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.300208 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.300356 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.300497 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.302400 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.303682 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.303849 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.304057 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.304235 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.304389 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.304542 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.304684 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.304825 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.304976 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.305119 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.305268 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.305415 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.305565 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.305723 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.305865 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.306065 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.306210 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.306352 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.306491 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.306644 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.306786 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.306968 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.307152 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.307295 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.307446 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.307690 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.307850 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.308002 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.308206 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.308484 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.308749 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.308918 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.309073 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.309215 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.309364 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.309549 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.309781 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.309935 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.310076 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.310223 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.310384 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.310537 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.310687 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.310839 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.310989 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.311962 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.312129 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.312287 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.312287 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.312565 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.312706 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.312854 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.313020 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.313383 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.314781 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.314943 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.315104 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.315311 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.315311 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.315724 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.315874 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.316017 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.316168 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.316339 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.316498 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.316660 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.316802 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.316960 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.317116 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.317266 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.317408 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.317548 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.317704 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.317852 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.318007 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.318155 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.318296 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.318437 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.318594 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.318746 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.318887 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.319064 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.319208 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.319354 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.319504 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.319695 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.319848 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.320008 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.320244 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.320391 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.320540 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.320700 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.320850 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.320992 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.321140 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.321666 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.321928 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.322177 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.322352 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.322503 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.322645 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.322785 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.322934 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.323090 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.323252 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.323401 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.323568 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.323727 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.323879 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.324022 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.324169 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.324311 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.324491 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.324645 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.324806 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.324954 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.325115 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.325115 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.325393 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.325548 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.325695 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.325843 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.325984 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.326135 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.326282 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.326434 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.326574 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.326714 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.326869 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.327032 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.327176 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.327317 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.327457 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.327658 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.327814 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.327965 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.328225 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.328376 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.328525 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.328673 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.328830 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.328987 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.329127 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.329434 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.329584 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.329726 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.329933 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.330078 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.330218 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.330360 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.330508 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.330655 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.330805 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.330955 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.331117 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.331259 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.331259 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.332584 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.332715 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.332810 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.332898 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.332987 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.333081 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.333175 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.333269 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.333354 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.333437 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.333520 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.333611 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.333711 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.333803 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.333887 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.333977 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.334074 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.334167 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.334252 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.334343 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:55:12.334428 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.334512 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.334595 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.334678 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.334761 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.334852 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.334933 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.335010 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.335103 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.335188 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.335280 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.335372 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.335464 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.335573 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.335664 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.335747 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.335828 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.335902 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.335980 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.336052 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.336130 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.336211 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.336293 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.336373 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.336509 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.336617 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.336704 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.336777 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.336862 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.336935 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.337006 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.337084 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.337158 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.337237 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.337310 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.337380 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.337457 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.337529 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.337607 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.337687 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.337759 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.337837 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.337909 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.337909 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.338038 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.338117 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.338197 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.338270 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.338346 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.338419 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.338496 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.338581 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.338661 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.338739 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.338818 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.338896 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.338980 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.339053 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.339148 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.339221 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.339301 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.339373 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.339458 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.339531 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.339710 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.339785 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.339863 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.339941 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.340026 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.340105 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.340184 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.340265 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.340336 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.340406 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.340488 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.340560 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.340631 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.340702 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.340772 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.340854 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.340927 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.341026 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.341100 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.341170 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.341240 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.341320 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.341400 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.341489 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.341489 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.341629 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.341724 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.341814 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.341886 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.341964 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.342036 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.342115 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.342115 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.342115 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.342115 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.342387 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.342482 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.342579 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.342664 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.342743 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.342823 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.342902 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.342990 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.343071 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.343151 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.343224 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.343295 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.343371 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.343450 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.343528 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.343636 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.343717 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.343809 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.343894 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.343977 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.344059 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.344154 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.344246 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.344331 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.344411 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.344503 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.344583 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.344670 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.344749 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.344840 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.344925 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.345014 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.345101 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.345173 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.345243 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.345326 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.345409 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.345500 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.345659 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.345756 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.345847 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.345939 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.346023 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.346108 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.346200 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.346273 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.346351 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.346430 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.346501 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.346578 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.346669 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.346754 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.347490 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.348224 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.348333 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.348479 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.348577 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.348664 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.348758 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.348845 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.348936 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.349035 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.349123 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.349214 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.349305 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.349390 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.349481 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.349582 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.349675 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.349761 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.349845 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.349936 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.350028 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.350122 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.350215 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.350307 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.350393 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.350476 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.350573 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.350659 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.350749 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.350834 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.350917 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.351001 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.351093 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.351178 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.351269 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.351360 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.351446 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.351529 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.351945 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.352054 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.352141 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.352234 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.352319 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.352403 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.352495 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.352612 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.352738 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.352923 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.353053 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.353255 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.353376 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.353570 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.353666 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.353880 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.353972 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.354190 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.354283 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.354502 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.354602 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.354850 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.354949 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.355159 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.355259 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.355477 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.355638 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.355815 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.355908 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.356138 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.356230 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.356449 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.356604 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.356767 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.356901 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.357114 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.357213 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.357371 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.357464 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.357700 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.357807 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.358013 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.358140 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.358327 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.358426 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.358640 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.358741 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.358956 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.359062 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.359267 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.359371 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.359595 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.359706 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.359912 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.360012 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.360221 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.360321 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.360530 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.360634 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.360838 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.360929 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.361150 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.361248 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.361462 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.361562 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.361772 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.361865 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.362078 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.362170 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.362390 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.362490 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.362697 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.362798 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.363002 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.363093 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.363330 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.363423 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.363666 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.363751 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.363991 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.364094 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.364310 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.364403 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.364631 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.364721 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.364946 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.365045 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.365249 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.365347 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.365552 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.365654 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.365874 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.365975 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.366183 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.366387 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.366524 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.366644 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.366798 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.367120 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.367505 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.367844 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.368193 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.368508 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.368817 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.369140 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.369453 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.369847 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.370328 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.370443 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.370666 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.370772 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.370995 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.371094 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.371347 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.371491 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.371691 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.371843 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.372024 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.372176 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.372358 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.372501 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.372681 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.372819 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.373010 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.373138 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.373341 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.373481 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.373668 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.373771 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.373994 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.374130 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.374313 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.374472 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.374643 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.374744 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.374966 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.375058 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.375284 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.375390 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.375609 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.375740 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.375930 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.376049 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.376255 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.376389 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.376723 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.376857 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.376984 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.377165 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.377320 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.377484 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.377580 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.377803 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.377896 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.378158 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.378280 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.378478 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.378572 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.378813 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.378926 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.379144 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.379236 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.379458 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.379602 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.379792 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.379900 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.380103 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.380203 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.380410 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.380502 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.380716 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.380810 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.381029 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.381121 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.381336 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.381427 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.381643 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.381743 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.381948 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.382040 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.382259 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.382351 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.382566 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.382673 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.382871 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.382973 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.383176 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.383276 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.383483 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.383602 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.383824 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.383914 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.384127 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.384267 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.384443 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.384545 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.384750 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.384849 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.385074 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.385178 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.385383 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.385484 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.385689 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.385782 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.385994 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.386098 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.386300 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.386392 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.386624 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.386715 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.386935 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.387208 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.387308 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.387591 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.387688 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.387906 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.388013 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.388235 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.388336 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.388555 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.388667 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.388883 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.388996 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.389190 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.389291 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.389498 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.389603 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.389803 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.389896 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.390115 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.390214 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.390424 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.390525 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.390727 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.390820 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.391041 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.391135 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.391353 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.391446 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.391686 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.391781 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.391999 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.392093 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.392304 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.392397 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.392615 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.392708 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.392921 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.393022 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.393229 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.393368 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.393538 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.393663 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.393843 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.393940 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.394153 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.394255 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.394973 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.395110 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.395285 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.395391 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.395612 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.395712 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.395925 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.396073 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.396231 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.396339 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.396546 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.396638 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.396851 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.396951 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.397158 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.397292 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.397464 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.397557 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.397774 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.397867 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.398084 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.398185 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.398391 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.398484 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.398714 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.398814 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.399026 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.399120 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.399333 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.399433 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.399658 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.399753 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.399970 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.400064 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.400274 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.400374 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.400581 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.400681 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.400891 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.400984 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.401213 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.401306 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.401529 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.401636 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.401833 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.401926 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.402141 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.402223 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.402446 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.402585 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.402753 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.402867 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.403043 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.403170 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.403353 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.403486 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.403681 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.403804 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.403985 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.404107 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.404290 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.404485 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.404607 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.404720 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.404886 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.405005 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.405199 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.405318 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.405506 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.405812 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.406117 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.406420 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.406763 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.407068 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.407428 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.407566 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.407759 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.407880 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.408076 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.408220 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.408398 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.408559 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.408787 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.408969 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.409102 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.409223 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.409343 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.409544 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.409671 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.409873 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.410002 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.410757 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.410892 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.411272 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.411389 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.411487 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.411650 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.411745 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.411831 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.412021 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.412125 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.412339 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.412433 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.412651 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.412751 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.412974 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.413066 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.413298 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.413457 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.413619 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.413710 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.413922 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.414028 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.414233 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.414327 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.414546 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.414647 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.414860 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.414962 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.415172 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.415273 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.415492 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.415738 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.415846 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.415985 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.416124 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.416229 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.416434 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.416525 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.416746 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.416837 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.417054 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.417135 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.417362 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.417453 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.417675 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.417765 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.417984 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.418065 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.418290 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.418383 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.418613 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.418705 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.418927 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.419049 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.419234 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.419330 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.419561 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.419695 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.419870 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.419996 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.420184 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.420313 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.420489 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.420626 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.420870 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.421014 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.421201 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.421329 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.421533 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.421627 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.421906 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.422001 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.422152 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.422245 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.422465 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.422554 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.422778 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.422869 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.423092 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.423197 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.423399 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.423481 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.423743 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.423837 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.424057 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.424150 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.424372 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.424461 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.424703 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.424793 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.425022 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.425128 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.425341 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.425440 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.425671 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.425768 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.426003 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.426097 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.426312 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.426420 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.426619 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.426713 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.426924 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.427025 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.427243 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.427336 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.427565 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.427672 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.427891 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.427991 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.428208 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.428301 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.428524 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.428622 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.428845 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.428939 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.429162 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.429352 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.429481 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.429628 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.429797 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.429932 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.430112 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.430215 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.430427 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.430529 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.430740 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.430857 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.431052 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.431178 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.431385 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.431491 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.431728 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.431823 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.432039 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.432140 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.432360 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.432454 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.432672 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.432765 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.432989 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.433081 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.433301 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.433395 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.433662 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.433754 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.433989 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.434083 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.434308 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.434402 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.434636 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.434737 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.434961 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.435058 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.435280 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.435380 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.435625 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.435722 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.435947 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.436057 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.436261 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.436364 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.436617 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.436709 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.436926 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.437033 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.437241 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.437341 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.437550 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.437644 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.437857 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.437951 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.438182 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.438283 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.438490 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.438596 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.438803 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.438904 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.439117 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.439211 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.439431 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.439593 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.439770 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.439866 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.440074 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.440167 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.440398 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.440501 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.440704 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.440797 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.441025 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.441126 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.441365 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.441470 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.441689 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.441821 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.442011 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.442178 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.442316 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.442504 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.442637 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.442948 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.443252 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.443600 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.443928 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.444265 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.444601 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.444918 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.445242 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.445561 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.445655 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.445895 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.445978 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.446448 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.446779 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.447121 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.447244 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.447472 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.447624 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.447989 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.448142 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.448287 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.448379 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.448501 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.448617 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.448844 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.448961 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.449174 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.449275 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.449496 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.449611 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.449828 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.450040 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.450170 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.450379 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.450474 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.450703 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.450797 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.451037 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.451137 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.451364 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.451491 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.451706 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.451835 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.452030 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.452137 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.452346 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.452444 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.452667 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.452772 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.452979 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.453065 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.453312 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.453407 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.453626 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.453721 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.453937 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.454031 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.454255 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.454347 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.454571 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.454663 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.454882 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.454974 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.455192 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.455292 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.455502 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.455663 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.455848 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.455948 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.456171 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.456263 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.456492 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.456597 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.456809 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.457415 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.457665 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.457759 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.457978 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.458084 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.458297 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.458390 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.458611 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.458703 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.458924 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.459029 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.459237 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.459330 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.459572 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.459679 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.459894 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.460062 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.460212 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.460319 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.460532 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.460623 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.460850 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.460945 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.461175 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.461275 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.461503 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.461733 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.461841 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.462066 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.462160 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.462384 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.462485 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.462700 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.462794 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.463016 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.463117 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.463333 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.463427 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.463672 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.463820 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.463988 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.464109 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.464302 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.464403 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.464616 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.464710 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.464927 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.465021 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.465258 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.465350 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.465576 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.465677 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.465889 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.465983 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.466200 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.466301 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.466513 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.466606 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.466845 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.466936 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.467159 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.467318 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.467478 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.467616 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.467847 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.467939 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.468161 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.468255 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.468475 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.468574 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.468785 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.468884 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.469100 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.469200 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.469418 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.469518 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.469732 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.469832 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.470050 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.470156 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.470371 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.470466 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.470688 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.470771 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.471003 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.471097 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.471318 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.471410 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.471657 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.471766 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.471975 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.472070 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.472297 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.472395 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.472688 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.473298 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.473496 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.473596 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.473811 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.473904 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.474128 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.474229 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.474446 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.474582 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.474973 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.475073 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.475299 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.475454 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.475663 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.475794 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.476138 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.476265 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.476397 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.476519 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.476639 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.477014 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.477172 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.477293 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.477493 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.477621 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.477803 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.477930 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.478111 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.478232 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.478426 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.478545 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.478737 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.478856 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.479042 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.479171 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.479368 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.479488 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.479705 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.479827 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.480014 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.480162 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.480369 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.480486 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.480636 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.480764 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.480983 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.481177 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.481343 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.481530 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.481666 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.481848 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.481979 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.482175 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.482301 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.482500 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.482622 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.482821 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.482989 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.483132 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.483233 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.483458 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.483580 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.483884 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.484015 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.484190 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.484304 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.484513 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.484617 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.484829 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.484929 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.485145 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.485238 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.485453 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.485558 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.485769 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.485867 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.486082 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.486187 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.486388 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.486493 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.486701 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.486800 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.487008 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.487105 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.487336 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.487442 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.487667 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.487985 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.488084 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.488248 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.488347 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.488596 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.488691 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.488921 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.489014 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.489203 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.489308 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.489512 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.489617 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.489812 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.489915 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.490127 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.490224 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.490432 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.490538 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.491106 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.491206 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.491337 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.491424 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.491510 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.491620 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.492019 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.492114 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.492197 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.492285 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.492359 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.492451 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.492860 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.492967 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.493052 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.493134 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.493527 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.493627 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.493710 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.493941 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.494045 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.494251 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.494345 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.494517 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.494617 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.494813 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.494920 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.495145 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.495241 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.495470 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.495668 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.495870 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.496112 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.496212 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.496439 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.496544 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.496752 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.496859 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.497074 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.497179 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.497484 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.497588 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.497774 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.497867 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.498060 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.498152 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.498337 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.498437 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.498613 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.498712 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.498927 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.499032 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.499240 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.499343 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.499584 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.499694 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.499882 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.500030 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.500190 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.500339 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.500493 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.500659 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.501257 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.501464 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.501625 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.501777 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.501932 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.502106 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.502726 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.502971 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.503154 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.503307 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.503471 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.503669 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.503845 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.504001 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.504157 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.504316 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.504474 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.504624 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.504771 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.504919 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.505067 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.505233 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.505396 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.505555 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.505704 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.505860 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.506009 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.506171 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.506320 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.506470 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.506624 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.506780 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.506929 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.507085 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.507251 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.507401 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.507580 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.508188 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.508466 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.508656 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.508818 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.508980 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.509186 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.509436 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.509616 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.509796 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.509965 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.510123 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.510273 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.510273 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.510583 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.510736 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.510993 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.511517 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.511708 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.511869 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.512029 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.512185 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.512335 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.512501 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.512658 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.512817 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.512994 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.513236 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.513391 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.513539 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.513695 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.513860 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.514019 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.514176 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.514326 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.514488 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.514645 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.514868 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.515035 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.515210 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.515409 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.515618 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.515775 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.515944 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.516095 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.516243 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.516391 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.516539 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.516711 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.516861 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.517010 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.517159 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.517316 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.517466 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.517623 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.517773 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.518012 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.518166 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.518315 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.518472 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.518646 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.518796 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.518953 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.519146 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.519146 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.520061 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.520228 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.520379 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.520534 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.520683 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.520832 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.521001 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.521253 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.521768 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.521935 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.522095 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.522254 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.522413 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.522570 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.522727 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.522876 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.523086 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.523357 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.523524 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.523714 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.523884 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.524033 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.524183 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.524346 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.524505 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.524661 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.524811 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.524966 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.525115 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.525273 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.525429 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.525578 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.525725 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.525890 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.526047 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.526209 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.526360 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.526509 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.526664 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.526827 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.526978 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.527140 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.527298 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.527455 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.527455 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.527802 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.527962 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.528206 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.528361 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.529247 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.529424 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.529579 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.529740 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.529892 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.530241 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.530400 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.530561 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.530712 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.530890 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.531090 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.531271 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.531870 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.532036 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.532235 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.532425 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.532619 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.532769 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.532917 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.533065 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.533228 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.533414 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.533715 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.533889 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.534047 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.534204 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.534367 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.534523 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.534680 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.534837 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.534986 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.535721 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.535904 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.536056 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.536224 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.536381 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.536537 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.536701 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.536852 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.537007 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.537163 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.537335 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.537525 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.537525 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.537845 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.537994 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.538143 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.538391 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.538547 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.538708 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.538865 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.539023 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.539173 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.539321 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.539479 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.539653 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.539803 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.539965 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.540115 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.540273 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.540434 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.540584 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.540739 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.540894 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.541059 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.541213 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.541374 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.541609 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.542147 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.542314 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.542465 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 07 15:55:12.542614 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.542614 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.542614 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.542614 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.542614 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.542614 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.542614 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.542614 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.543899 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.543899 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.543899 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.543899 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.543899 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.543899 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.543899 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.543899 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.545044 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.545044 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.545044 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.545044 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.545044 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.545044 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.545044 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.545044 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.546157 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.546157 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.546157 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.546157 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.546157 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.546157 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.546157 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.546157 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.547285 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.547285 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.547285 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.547285 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.547285 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.548138 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.548138 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.548138 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.548685 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:55:12.548685 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 07 15:55:12.597151 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO dbcounter [None req-575efc67-457b-4dae-b8fd-8050663b3236 None None] Registered counter for database nova_api Sep 07 15:55:12.610789 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO dbcounter [None req-db537f9c-678a-415f-bcbf-ccd464066863 None None] Registered counter for database nova_api Sep 07 15:55:12.618860 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_db.sqlalchemy.engines [None req-575efc67-457b-4dae-b8fd-8050663b3236 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120641) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 15:55:12.625542 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writer thread running {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 15:55:12.632246 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_db.sqlalchemy.engines [None req-db537f9c-678a-415f-bcbf-ccd464066863 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120640) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 15:55:12.639032 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writer thread running {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 15:55:12.682373 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.context [None req-575efc67-457b-4dae-b8fd-8050663b3236 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),13f76085-40f9-4e0c-a81d-300476f83c4c(cell1) {{(pid=120641) load_cells /opt/stack/nova/nova/context.py:464}} Sep 07 15:55:12.686515 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-575efc67-457b-4dae-b8fd-8050663b3236 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:55:12.686971 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-575efc67-457b-4dae-b8fd-8050663b3236 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:55:12.688591 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-575efc67-457b-4dae-b8fd-8050663b3236 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:55:12.689326 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-575efc67-457b-4dae-b8fd-8050663b3236 None None] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:55:12.689774 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-575efc67-457b-4dae-b8fd-8050663b3236 None None] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:55:12.692335 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-575efc67-457b-4dae-b8fd-8050663b3236 None None] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:55:12.694354 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO dbcounter [None req-575efc67-457b-4dae-b8fd-8050663b3236 None None] Registered counter for database nova_cell0 Sep 07 15:55:12.696559 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.context [None req-db537f9c-678a-415f-bcbf-ccd464066863 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),13f76085-40f9-4e0c-a81d-300476f83c4c(cell1) {{(pid=120640) load_cells /opt/stack/nova/nova/context.py:464}} Sep 07 15:55:12.698514 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO dbcounter [None req-575efc67-457b-4dae-b8fd-8050663b3236 None None] Registered counter for database nova_cell1 Sep 07 15:55:12.700650 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db537f9c-678a-415f-bcbf-ccd464066863 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:55:12.701125 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db537f9c-678a-415f-bcbf-ccd464066863 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:55:12.702695 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db537f9c-678a-415f-bcbf-ccd464066863 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:55:12.703452 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db537f9c-678a-415f-bcbf-ccd464066863 None None] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:55:12.703926 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db537f9c-678a-415f-bcbf-ccd464066863 None None] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:55:12.705901 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_db.sqlalchemy.engines [None req-575efc67-457b-4dae-b8fd-8050663b3236 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120641) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 15:55:12.706059 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db537f9c-678a-415f-bcbf-ccd464066863 None None] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:55:12.708628 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO dbcounter [None req-db537f9c-678a-415f-bcbf-ccd464066863 None None] Registered counter for database nova_cell0 Sep 07 15:55:12.711738 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writer thread running {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 15:55:12.713296 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO dbcounter [None req-db537f9c-678a-415f-bcbf-ccd464066863 None None] Registered counter for database nova_cell1 Sep 07 15:55:12.719918 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_db.sqlalchemy.engines [None req-db537f9c-678a-415f-bcbf-ccd464066863 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120640) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 15:55:12.721650 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_db.sqlalchemy.engines [None req-db537f9c-678a-415f-bcbf-ccd464066863 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120640) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 15:55:12.727525 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writer thread running {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 15:55:12.730205 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writer thread running {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 15:55:12.849867 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_db.sqlalchemy.engines [None req-575efc67-457b-4dae-b8fd-8050663b3236 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120641) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 15:55:12.855684 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writer thread running {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 15:55:12.864390 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO dbcounter [None req-575efc67-457b-4dae-b8fd-8050663b3236 None None] Registered counter for database nova_cell0 Sep 07 15:55:12.873038 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_db.sqlalchemy.engines [None req-575efc67-457b-4dae-b8fd-8050663b3236 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120641) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 15:55:12.876905 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO dbcounter [None req-db537f9c-678a-415f-bcbf-ccd464066863 None None] Registered counter for database nova_cell0 Sep 07 15:55:12.877343 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writer thread running {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 15:55:12.883865 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_db.sqlalchemy.engines [None req-db537f9c-678a-415f-bcbf-ccd464066863 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120640) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 15:55:12.888238 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writer thread running {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 15:55:13.196235 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: WARNING keystonemiddleware.auth_token [None req-575efc67-457b-4dae-b8fd-8050663b3236 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 15:55:13.203469 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: WARNING keystonemiddleware.auth_token [None req-575efc67-457b-4dae-b8fd-8050663b3236 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 15:55:13.214625 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: WARNING keystonemiddleware.auth_token [None req-db537f9c-678a-415f-bcbf-ccd464066863 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 15:55:13.221897 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: WARNING keystonemiddleware.auth_token [None req-db537f9c-678a-415f-bcbf-ccd464066863 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 15:55:13.549473 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: WARNING keystonemiddleware.auth_token [None req-575efc67-457b-4dae-b8fd-8050663b3236 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 15:55:13.556456 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: WARNING keystonemiddleware.auth_token [None req-575efc67-457b-4dae-b8fd-8050663b3236 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 15:55:13.561742 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ca592809c0 pid: 120641 (default app) Sep 07 15:55:13.565422 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: WARNING keystonemiddleware.auth_token [None req-db537f9c-678a-415f-bcbf-ccd464066863 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 15:55:13.571401 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: WARNING keystonemiddleware.auth_token [None req-db537f9c-678a-415f-bcbf-ccd464066863 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 15:55:13.576715 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ca592809c0 pid: 120640 (default app) Sep 07 15:55:49.063988 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=3 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:49.065219 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=3 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:49.066134 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=3 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:49.066876 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=3 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:50.015396 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-77ad4836-3f4e-4486-ab6a-b793698e49d4 tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] Action: 'create', calling method: .version_select at 0x7ff9a6bc24c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-155075748"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:55:50.341726 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:50.343443 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:50.353435 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:50.355120 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:55:51.506687 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b862af87-4859-4cb0-9943-ae09a1a6723e tempest-VolumesNegativeTest-1596495973 tempest-VolumesNegativeTest-1596495973-project] Action: 'create', calling method: .version_select at 0x7ff9a6bbe3a0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1951962385", "metadata": {"Type": "work"}}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:55:51.519180 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b862af87-4859-4cb0-9943-ae09a1a6723e tempest-VolumesNegativeTest-1596495973 tempest-VolumesNegativeTest-1596495973-project] Request method failure captured: Sep 07 15:55:51.519180 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 07 15:55:51.519180 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept: application/json Sep 07 15:55:51.519180 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Sep 07 15:55:51.519180 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Connection: close Sep 07 15:55:51.519180 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Length: 122 Sep 07 15:55:51.519180 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Type: application/json Sep 07 15:55:51.519180 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Host: 10.222.0.17 Sep 07 15:55:51.519180 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Sep 07 15:55:51.519180 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Sep 07 15:55:51.519180 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjGL8GoVNFHa5TzLQm4zpPfyB1pTePzuQc5y6fYqTiJCMHvblDPpCxpbOTpkMDH79Nh0e3cL12k3cGNV6B8UBJXQl4xyBpe7ra4fE7UbwMzHx5Gu6-N3xt1UxjySLEkBEqjTLIVrvOn2edbIXeJ5xYWYFpYIqGqa0hQeJ9-emmUcxZHDQ Sep 07 15:55:51.519180 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Sep 07 15:55:51.519180 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Sep 07 15:55:51.519180 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Sep 07 15:55:51.519180 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Sep 07 15:55:51.519180 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Sep 07 15:55:51.519180 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Sep 07 15:55:51.519180 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Id: 2d357053af334b5090309eae0d444d95 Sep 07 15:55:51.519180 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-VolumesNegativeTest-1596495973 Sep 07 15:55:51.519180 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Role: reader,member Sep 07 15:55:51.519180 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Roles: reader,member Sep 07 15:55:51.520887 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2d357053af334b5090309eae0d444d95", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2d357053af334b5090309eae0d444d95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2d357053af334b5090309eae0d444d95"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2d357053af334b5090309eae0d444d95"}]}] Sep 07 15:55:51.520887 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-VolumesNegativeTest-1596495973 Sep 07 15:55:51.520887 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Id: 2d357053af334b5090309eae0d444d95 Sep 07 15:55:51.520887 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-VolumesNegativeTest-1596495973 Sep 07 15:55:51.520887 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User: tempest-VolumesNegativeTest-1596495973-project Sep 07 15:55:51.520887 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Sep 07 15:55:51.520887 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Sep 07 15:55:51.520887 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Id: 4feedcde86d04d2395b09ae65dee4ad9 Sep 07 15:55:51.520887 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-VolumesNegativeTest-1596495973-project Sep 07 15:55:51.520887 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Sep 07 15:55:51.520887 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1951962385", "metadata": {"Type": "work"}}} Sep 07 15:55:51.520887 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: method: Sep 07 15:55:51.520887 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 07 15:55:51.521892 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1951962385', 'metadata': {'Type': 'work'}}}} Sep 07 15:55:51.521892 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 15:55:51.521892 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:55:51.521892 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 15:55:51.521892 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 15:55:51.521892 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 15:55:51.521892 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise error Sep 07 15:55:51.521892 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 07 15:55:51.521892 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:55:51.521892 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 07 15:55:51.521892 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 07 15:55:51.521892 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:55:51.521892 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 07 15:55:51.521892 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi '#$%' Sep 07 15:55:51.521892 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:55:51.521892 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 15:55:51.521892 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:55:51.521892 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:55:51.521892 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 15:55:51.521892 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 15:55:51.521892 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 15:55:51.521892 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 15:55:51.523938 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 15:55:51.523938 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 15:55:51.523938 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 15:55:51.523938 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 15:55:51.523938 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 15:55:51.523938 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 15:55:51.523938 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 15:55:51.523938 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 15:55:51.523938 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 15:55:51.523938 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 15:55:51.523938 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 07 15:55:51.523938 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:55:51.523938 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 15:55:51.523938 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:55:51.523938 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:55:51.523938 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 15:55:51.523938 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 15:55:51.523938 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 15:55:51.523938 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 15:55:51.525394 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 07 15:55:51.525394 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:55:51.528006 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b862af87-4859-4cb0-9943-ae09a1a6723e tempest-VolumesNegativeTest-1596495973 tempest-VolumesNegativeTest-1596495973-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 15:55:51.529817 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b862af87-4859-4cb0-9943-ae09a1a6723e tempest-VolumesNegativeTest-1596495973 tempest-VolumesNegativeTest-1596495973-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.200178 Sep 07 15:55:51.530612 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 1/1] 10.222.0.17 () {60 vars in 1156 bytes} [Wed Sep 7 15:55:50 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1203 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 15:55:51.547827 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5c18c019-3269-4408-bb0b-73f84c8dfbe8 tempest-VolumesNegativeTest-1596495973 tempest-VolumesNegativeTest-1596495973-project] Action: 'create', calling method: .version_select at 0x7ff9a6bbef70>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-577155", "metadata": {"Type": "work"}}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:55:51.556348 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5c18c019-3269-4408-bb0b-73f84c8dfbe8 tempest-VolumesNegativeTest-1596495973 tempest-VolumesNegativeTest-1596495973-project] Request method failure captured: Sep 07 15:55:51.556348 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 07 15:55:51.556348 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept: application/json Sep 07 15:55:51.556348 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Sep 07 15:55:51.556348 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Connection: close Sep 07 15:55:51.556348 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Length: 116 Sep 07 15:55:51.556348 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Type: application/json Sep 07 15:55:51.556348 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Host: 10.222.0.17 Sep 07 15:55:51.556348 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Sep 07 15:55:51.556348 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Sep 07 15:55:51.556348 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjGL8GoVNFHa5TzLQm4zpPfyB1pTePzuQc5y6fYqTiJCMHvblDPpCxpbOTpkMDH79Nh0e3cL12k3cGNV6B8UBJXQl4xyBpe7ra4fE7UbwMzHx5Gu6-N3xt1UxjySLEkBEqjTLIVrvOn2edbIXeJ5xYWYFpYIqGqa0hQeJ9-emmUcxZHDQ Sep 07 15:55:51.556348 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Sep 07 15:55:51.556348 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Sep 07 15:55:51.556348 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Sep 07 15:55:51.556348 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Sep 07 15:55:51.556348 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Sep 07 15:55:51.556348 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Sep 07 15:55:51.556348 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Id: 2d357053af334b5090309eae0d444d95 Sep 07 15:55:51.556348 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-VolumesNegativeTest-1596495973 Sep 07 15:55:51.556348 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Role: reader,member Sep 07 15:55:51.556348 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Roles: reader,member Sep 07 15:55:51.558370 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2d357053af334b5090309eae0d444d95", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2d357053af334b5090309eae0d444d95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2d357053af334b5090309eae0d444d95"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2d357053af334b5090309eae0d444d95"}]}] Sep 07 15:55:51.558370 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-VolumesNegativeTest-1596495973 Sep 07 15:55:51.558370 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Id: 2d357053af334b5090309eae0d444d95 Sep 07 15:55:51.558370 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-VolumesNegativeTest-1596495973 Sep 07 15:55:51.558370 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User: tempest-VolumesNegativeTest-1596495973-project Sep 07 15:55:51.558370 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Sep 07 15:55:51.558370 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Sep 07 15:55:51.558370 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Id: 4feedcde86d04d2395b09ae65dee4ad9 Sep 07 15:55:51.558370 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-VolumesNegativeTest-1596495973-project Sep 07 15:55:51.558370 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Sep 07 15:55:51.558370 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-577155", "metadata": {"Type": "work"}}} Sep 07 15:55:51.558370 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: method: Sep 07 15:55:51.558370 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 07 15:55:51.559320 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-577155', 'metadata': {'Type': 'work'}}}} Sep 07 15:55:51.559320 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 15:55:51.559320 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:55:51.559320 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 15:55:51.559320 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 15:55:51.559320 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 15:55:51.559320 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise error Sep 07 15:55:51.559320 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 07 15:55:51.559320 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:55:51.559320 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 07 15:55:51.559320 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 07 15:55:51.559320 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:55:51.559320 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 07 15:55:51.559320 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi '0' Sep 07 15:55:51.559320 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:55:51.559320 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 15:55:51.559320 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:55:51.559320 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:55:51.559320 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 15:55:51.559320 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 15:55:51.559320 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 15:55:51.559320 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 15:55:51.562611 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 15:55:51.562611 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 15:55:51.562611 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 15:55:51.562611 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 15:55:51.562611 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 15:55:51.562611 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 15:55:51.562611 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 15:55:51.562611 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 15:55:51.562611 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 15:55:51.562611 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 15:55:51.562611 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 07 15:55:51.562611 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:55:51.562611 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 15:55:51.562611 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:55:51.562611 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:55:51.562611 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 15:55:51.562611 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 15:55:51.562611 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 15:55:51.562611 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 15:55:51.564892 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 07 15:55:51.564892 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:55:51.567808 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5c18c019-3269-4408-bb0b-73f84c8dfbe8 tempest-VolumesNegativeTest-1596495973 tempest-VolumesNegativeTest-1596495973-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 15:55:51.569012 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5c18c019-3269-4408-bb0b-73f84c8dfbe8 tempest-VolumesNegativeTest-1596495973 tempest-VolumesNegativeTest-1596495973-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.029836 Sep 07 15:55:51.570493 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 2/2] 10.222.0.17 () {60 vars in 1156 bytes} [Wed Sep 7 15:55:51 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 15:55:51.601857 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7c055f63-b436-40b0-9084-82f5ad98ff01 tempest-VolumesNegativeTest-1596495973 tempest-VolumesNegativeTest-1596495973-project] Action: 'create', calling method: .version_select at 0x7ff9a6a7d160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-542781633", "metadata": {"Type": "work"}}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:55:51.617442 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7c055f63-b436-40b0-9084-82f5ad98ff01 tempest-VolumesNegativeTest-1596495973 tempest-VolumesNegativeTest-1596495973-project] Request method failure captured: Sep 07 15:55:51.617442 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 07 15:55:51.617442 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept: application/json Sep 07 15:55:51.617442 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Sep 07 15:55:51.617442 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Connection: close Sep 07 15:55:51.617442 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Length: 118 Sep 07 15:55:51.617442 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Type: application/json Sep 07 15:55:51.617442 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Host: 10.222.0.17 Sep 07 15:55:51.617442 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Sep 07 15:55:51.617442 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Sep 07 15:55:51.617442 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjGL8GoVNFHa5TzLQm4zpPfyB1pTePzuQc5y6fYqTiJCMHvblDPpCxpbOTpkMDH79Nh0e3cL12k3cGNV6B8UBJXQl4xyBpe7ra4fE7UbwMzHx5Gu6-N3xt1UxjySLEkBEqjTLIVrvOn2edbIXeJ5xYWYFpYIqGqa0hQeJ9-emmUcxZHDQ Sep 07 15:55:51.617442 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Sep 07 15:55:51.617442 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Sep 07 15:55:51.617442 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Sep 07 15:55:51.617442 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Sep 07 15:55:51.617442 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Sep 07 15:55:51.617442 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Sep 07 15:55:51.617442 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Id: 2d357053af334b5090309eae0d444d95 Sep 07 15:55:51.617442 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-VolumesNegativeTest-1596495973 Sep 07 15:55:51.617442 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Role: reader,member Sep 07 15:55:51.617442 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Roles: reader,member Sep 07 15:55:51.618823 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2d357053af334b5090309eae0d444d95", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2d357053af334b5090309eae0d444d95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2d357053af334b5090309eae0d444d95"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2d357053af334b5090309eae0d444d95"}]}] Sep 07 15:55:51.618823 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-VolumesNegativeTest-1596495973 Sep 07 15:55:51.618823 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Id: 2d357053af334b5090309eae0d444d95 Sep 07 15:55:51.618823 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-VolumesNegativeTest-1596495973 Sep 07 15:55:51.618823 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User: tempest-VolumesNegativeTest-1596495973-project Sep 07 15:55:51.618823 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Sep 07 15:55:51.618823 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Sep 07 15:55:51.618823 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Id: 4feedcde86d04d2395b09ae65dee4ad9 Sep 07 15:55:51.618823 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-VolumesNegativeTest-1596495973-project Sep 07 15:55:51.618823 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Sep 07 15:55:51.618823 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-542781633", "metadata": {"Type": "work"}}} Sep 07 15:55:51.618823 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: method: Sep 07 15:55:51.618823 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 07 15:55:51.621004 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-542781633', 'metadata': {'Type': 'work'}}}} Sep 07 15:55:51.621004 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 15:55:51.621004 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:55:51.621004 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 15:55:51.621004 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 15:55:51.621004 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 15:55:51.621004 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise error Sep 07 15:55:51.621004 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 07 15:55:51.621004 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:55:51.621004 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 07 15:55:51.621004 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 07 15:55:51.621004 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:55:51.621004 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 07 15:55:51.621004 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi '' Sep 07 15:55:51.621004 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:55:51.621004 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 15:55:51.621004 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:55:51.621004 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:55:51.621004 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 15:55:51.621004 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 15:55:51.621004 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 15:55:51.621004 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 15:55:51.623240 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 15:55:51.623240 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 15:55:51.623240 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 15:55:51.623240 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 15:55:51.623240 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 15:55:51.623240 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 15:55:51.623240 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 15:55:51.623240 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 15:55:51.623240 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 15:55:51.623240 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 15:55:51.623240 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 07 15:55:51.623240 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:55:51.623240 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 15:55:51.623240 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:55:51.623240 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:55:51.623240 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 15:55:51.623240 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 15:55:51.623240 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 15:55:51.623240 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 15:55:51.626660 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 07 15:55:51.626660 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:55:51.626660 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7c055f63-b436-40b0-9084-82f5ad98ff01 tempest-VolumesNegativeTest-1596495973 tempest-VolumesNegativeTest-1596495973-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 15:55:51.626660 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7c055f63-b436-40b0-9084-82f5ad98ff01 tempest-VolumesNegativeTest-1596495973 tempest-VolumesNegativeTest-1596495973-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.041000 Sep 07 15:55:51.629238 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 3/3] 10.222.0.17 () {60 vars in 1156 bytes} [Wed Sep 7 15:55:51 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 15:55:51.636416 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-61267e63-f96f-4a3c-88c7-de3ef8b8eb03 tempest-VolumesNegativeTest-1596495973 tempest-VolumesNegativeTest-1596495973-project] Calling method '.version_select at 0x7ff9a6a7dc10>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:55:52.071484 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-77ad4836-3f4e-4486-ab6a-b793698e49d4 tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.030062 Sep 07 15:55:52.072406 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 1/4] 10.222.0.17 () {60 vars in 1155 bytes} [Wed Sep 7 15:55:49 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3032 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 07 15:55:52.090385 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6d67cb88-26a9-49a2-9fac-24b6dda69efc tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] Calling method '.version_select at 0x7ff9a6a943a0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:55:52.201390 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-61267e63-f96f-4a3c-88c7-de3ef8b8eb03 tempest-VolumesNegativeTest-1596495973 tempest-VolumesNegativeTest-1596495973-project] HTTP exception thrown: Volume tempest-invalid-54447077 could not be found. Sep 07 15:55:52.207065 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-61267e63-f96f-4a3c-88c7-de3ef8b8eb03 tempest-VolumesNegativeTest-1596495973 tempest-VolumesNegativeTest-1596495973-project] Request method failure captured: Sep 07 15:55:52.207065 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-54447077 HTTP/1.1 Sep 07 15:55:52.207065 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept: application/json Sep 07 15:55:52.207065 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Sep 07 15:55:52.207065 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Connection: close Sep 07 15:55:52.207065 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Length: 0 Sep 07 15:55:52.207065 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Type: application/json Sep 07 15:55:52.207065 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Host: 10.222.0.17 Sep 07 15:55:52.207065 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Sep 07 15:55:52.207065 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Sep 07 15:55:52.207065 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjGL8GoVNFHa5TzLQm4zpPfyB1pTePzuQc5y6fYqTiJCMHvblDPpCxpbOTpkMDH79Nh0e3cL12k3cGNV6B8UBJXQl4xyBpe7ra4fE7UbwMzHx5Gu6-N3xt1UxjySLEkBEqjTLIVrvOn2edbIXeJ5xYWYFpYIqGqa0hQeJ9-emmUcxZHDQ Sep 07 15:55:52.207065 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Sep 07 15:55:52.207065 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Sep 07 15:55:52.207065 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Sep 07 15:55:52.207065 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Sep 07 15:55:52.207065 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Sep 07 15:55:52.207065 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Sep 07 15:55:52.207065 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Id: 2d357053af334b5090309eae0d444d95 Sep 07 15:55:52.207065 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-VolumesNegativeTest-1596495973 Sep 07 15:55:52.207065 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Role: reader,member Sep 07 15:55:52.207065 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Roles: reader,member Sep 07 15:55:52.208750 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2d357053af334b5090309eae0d444d95", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2d357053af334b5090309eae0d444d95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2d357053af334b5090309eae0d444d95"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2d357053af334b5090309eae0d444d95"}]}] Sep 07 15:55:52.208750 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-VolumesNegativeTest-1596495973 Sep 07 15:55:52.208750 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Id: 2d357053af334b5090309eae0d444d95 Sep 07 15:55:52.208750 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-VolumesNegativeTest-1596495973 Sep 07 15:55:52.208750 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User: tempest-VolumesNegativeTest-1596495973-project Sep 07 15:55:52.208750 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Sep 07 15:55:52.208750 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Sep 07 15:55:52.208750 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Id: 4feedcde86d04d2395b09ae65dee4ad9 Sep 07 15:55:52.208750 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-VolumesNegativeTest-1596495973-project Sep 07 15:55:52.208750 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: method: Sep 07 15:55:52.208750 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: exception: Volume tempest-invalid-54447077 could not be found. Sep 07 15:55:52.208750 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: action_args: {'id': 'tempest-invalid-54447077'} Sep 07 15:55:52.208750 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 15:55:52.209584 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:55:52.209584 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 15:55:52.209584 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 15:55:52.209584 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 15:55:52.209584 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 15:55:52.209584 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 15:55:52.209584 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 15:55:52.209584 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 15:55:52.209584 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 15:55:52.209584 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 15:55:52.209584 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 15:55:52.209584 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 15:55:52.209584 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 15:55:52.209584 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 15:55:52.209584 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 15:55:52.209584 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-54447077 could not be found. (HTTP 404) (Request-ID: req-4fce6032-aa01-4f54-893a-2e28f97fb081) Sep 07 15:55:52.209584 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:55:52.209584 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 15:55:52.209584 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:55:52.210861 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:55:52.210861 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 07 15:55:52.210861 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 07 15:55:52.210861 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 15:55:52.210861 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 15:55:52.210861 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 15:55:52.210861 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 15:55:52.210861 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 15:55:52.210861 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 15:55:52.210861 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 15:55:52.210861 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 15:55:52.210861 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 15:55:52.210861 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 15:55:52.210861 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 15:55:52.210861 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 15:55:52.210861 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 15:55:52.210861 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 15:55:52.210861 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 15:55:52.210861 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 15:55:52.218189 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 15:55:52.218189 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 15:55:52.218189 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 15:55:52.218189 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 15:55:52.218189 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-54447077 could not be found. Sep 07 15:55:52.218189 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:55:52.218189 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 15:55:52.218189 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:55:52.218189 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:55:52.218189 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 15:55:52.218189 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 15:55:52.218189 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 15:55:52.218189 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 15:55:52.218189 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 15:55:52.218189 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 15:55:52.218189 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 15:55:52.218189 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 15:55:52.218189 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 07 15:55:52.218189 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 15:55:52.218189 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-54447077 could not be found. Sep 07 15:55:52.223141 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:55:52.223141 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 15:55:52.223141 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:55:52.223141 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:55:52.223141 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 15:55:52.223141 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 15:55:52.223141 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 15:55:52.223141 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 15:55:52.223141 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-54447077 could not be found. Sep 07 15:55:52.223141 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:55:52.223141 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-61267e63-f96f-4a3c-88c7-de3ef8b8eb03 tempest-VolumesNegativeTest-1596495973 tempest-VolumesNegativeTest-1596495973-project] Returning 404 to user: Volume tempest-invalid-54447077 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 15:55:52.223141 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-61267e63-f96f-4a3c-88c7-de3ef8b8eb03 tempest-VolumesNegativeTest-1596495973 tempest-VolumesNegativeTest-1596495973-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/tempest-invalid-54447077" status: 404 len: 97 microversion: 2.1 time: 0.579049 Sep 07 15:55:52.223141 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 4/5] 10.222.0.17 () {58 vars in 1212 bytes} [Wed Sep 7 15:55:51 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-54447077 => generated 97 bytes in 585 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 15:55:52.227814 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-47460bb0-179b-4c23-b581-9b10a511a865 tempest-VolumesNegativeTest-1596495973 tempest-VolumesNegativeTest-1596495973-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006401 Sep 07 15:55:52.229892 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 5/6] 10.222.0.17 () {58 vars in 1140 bytes} [Wed Sep 7 15:55:52 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 14 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 07 15:55:52.240465 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-39446dfd-1ce3-40e7-9b3e-855cbfe60bde tempest-VolumesNegativeTest-1596495973 tempest-VolumesNegativeTest-1596495973-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007698 Sep 07 15:55:52.241869 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 6/7] 10.222.0.17 () {58 vars in 1137 bytes} [Wed Sep 7 15:55:52 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 07 15:55:52.253780 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2124a3df-d925-4fe2-a20b-4eb803bddacc tempest-VolumesNegativeTest-1596495973 tempest-VolumesNegativeTest-1596495973-project] Calling method '.version_select at 0x7ff9a69af3a0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:55:52.283047 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6d67cb88-26a9-49a2-9fac-24b6dda69efc tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/8c06b938-7008-4367-8861-723717c78131" status: 200 len: 344 microversion: 2.1 time: 0.198458 Sep 07 15:55:52.288044 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 2/8] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Sep 7 15:55:52 2022] GET /compute/v2.1/os-volumes/8c06b938-7008-4367-8861-723717c78131 => generated 344 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 15:55:52.385349 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-2124a3df-d925-4fe2-a20b-4eb803bddacc tempest-VolumesNegativeTest-1596495973 tempest-VolumesNegativeTest-1596495973-project] HTTP exception thrown: Volume 1a7d744e-f374-4307-bce1-cfcac882c9fc could not be found. Sep 07 15:55:52.387591 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2124a3df-d925-4fe2-a20b-4eb803bddacc tempest-VolumesNegativeTest-1596495973 tempest-VolumesNegativeTest-1596495973-project] Request method failure captured: Sep 07 15:55:52.387591 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: request: DELETE /compute/v2.1/os-volumes/1a7d744e-f374-4307-bce1-cfcac882c9fc HTTP/1.1 Sep 07 15:55:52.387591 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept: application/json Sep 07 15:55:52.387591 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Sep 07 15:55:52.387591 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Connection: close Sep 07 15:55:52.387591 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Length: 0 Sep 07 15:55:52.387591 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Type: application/json Sep 07 15:55:52.387591 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Host: 10.222.0.17 Sep 07 15:55:52.387591 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Sep 07 15:55:52.387591 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Sep 07 15:55:52.387591 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjGL8GoVNFHa5TzLQm4zpPfyB1pTePzuQc5y6fYqTiJCMHvblDPpCxpbOTpkMDH79Nh0e3cL12k3cGNV6B8UBJXQl4xyBpe7ra4fE7UbwMzHx5Gu6-N3xt1UxjySLEkBEqjTLIVrvOn2edbIXeJ5xYWYFpYIqGqa0hQeJ9-emmUcxZHDQ Sep 07 15:55:52.387591 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Sep 07 15:55:52.387591 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Sep 07 15:55:52.387591 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Sep 07 15:55:52.387591 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Sep 07 15:55:52.387591 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Sep 07 15:55:52.387591 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Sep 07 15:55:52.387591 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Id: 2d357053af334b5090309eae0d444d95 Sep 07 15:55:52.387591 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-VolumesNegativeTest-1596495973 Sep 07 15:55:52.387591 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Role: reader,member Sep 07 15:55:52.387591 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Roles: reader,member Sep 07 15:55:52.388846 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2d357053af334b5090309eae0d444d95", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2d357053af334b5090309eae0d444d95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2d357053af334b5090309eae0d444d95"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2d357053af334b5090309eae0d444d95"}]}] Sep 07 15:55:52.388846 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-VolumesNegativeTest-1596495973 Sep 07 15:55:52.388846 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Id: 2d357053af334b5090309eae0d444d95 Sep 07 15:55:52.388846 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-VolumesNegativeTest-1596495973 Sep 07 15:55:52.388846 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User: tempest-VolumesNegativeTest-1596495973-project Sep 07 15:55:52.388846 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Sep 07 15:55:52.388846 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Sep 07 15:55:52.388846 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Id: 4feedcde86d04d2395b09ae65dee4ad9 Sep 07 15:55:52.388846 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-VolumesNegativeTest-1596495973-project Sep 07 15:55:52.388846 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: method: Sep 07 15:55:52.388846 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: exception: Volume 1a7d744e-f374-4307-bce1-cfcac882c9fc could not be found. Sep 07 15:55:52.388846 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: action_args: {'id': '1a7d744e-f374-4307-bce1-cfcac882c9fc'} Sep 07 15:55:52.388846 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 15:55:52.389700 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:55:52.389700 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 15:55:52.389700 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 15:55:52.389700 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 15:55:52.389700 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 15:55:52.389700 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 15:55:52.389700 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 15:55:52.389700 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 15:55:52.389700 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 15:55:52.389700 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 15:55:52.389700 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 15:55:52.389700 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 15:55:52.389700 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 15:55:52.389700 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 15:55:52.389700 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 15:55:52.389700 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1a7d744e-f374-4307-bce1-cfcac882c9fc could not be found. (HTTP 404) (Request-ID: req-8bcf4b7a-663f-42b7-b271-245966ee037d) Sep 07 15:55:52.389700 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:55:52.389700 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 15:55:52.389700 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:55:52.390785 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:55:52.390785 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 07 15:55:52.390785 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 07 15:55:52.390785 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 15:55:52.390785 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 15:55:52.390785 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 15:55:52.390785 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 15:55:52.390785 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 15:55:52.390785 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 15:55:52.390785 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 15:55:52.390785 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 15:55:52.390785 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 15:55:52.390785 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 15:55:52.390785 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 15:55:52.390785 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 15:55:52.390785 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 15:55:52.390785 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 15:55:52.390785 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 15:55:52.390785 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 15:55:52.391937 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 15:55:52.391937 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 15:55:52.391937 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 15:55:52.391937 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 15:55:52.391937 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1a7d744e-f374-4307-bce1-cfcac882c9fc could not be found. Sep 07 15:55:52.391937 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:55:52.391937 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 15:55:52.391937 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:55:52.391937 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:55:52.391937 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 15:55:52.391937 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 15:55:52.391937 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 15:55:52.391937 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 15:55:52.391937 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 15:55:52.391937 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 15:55:52.391937 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 15:55:52.391937 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 15:55:52.391937 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 07 15:55:52.391937 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 15:55:52.397024 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1a7d744e-f374-4307-bce1-cfcac882c9fc could not be found. Sep 07 15:55:52.397024 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:55:52.397024 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 15:55:52.397024 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:55:52.397024 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:55:52.397024 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 15:55:52.397024 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 15:55:52.397024 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 15:55:52.397024 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 15:55:52.397024 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1a7d744e-f374-4307-bce1-cfcac882c9fc could not be found. Sep 07 15:55:52.397024 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:55:52.397024 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2124a3df-d925-4fe2-a20b-4eb803bddacc tempest-VolumesNegativeTest-1596495973 tempest-VolumesNegativeTest-1596495973-project] Returning 404 to user: Volume 1a7d744e-f374-4307-bce1-cfcac882c9fc could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 15:55:52.397024 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2124a3df-d925-4fe2-a20b-4eb803bddacc tempest-VolumesNegativeTest-1596495973 tempest-VolumesNegativeTest-1596495973-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/1a7d744e-f374-4307-bce1-cfcac882c9fc" status: 404 len: 109 microversion: 2.1 time: 0.141590 Sep 07 15:55:52.397024 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 7/9] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Sep 7 15:55:52 2022] DELETE /compute/v2.1/os-volumes/1a7d744e-f374-4307-bce1-cfcac882c9fc => generated 109 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 15:55:52.404060 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-78446f64-067b-4e2a-b4e1-20127f126832 tempest-VolumesNegativeTest-1596495973 tempest-VolumesNegativeTest-1596495973-project] Calling method '.version_select at 0x7ff9a6a94a60>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:55:52.562426 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-78446f64-067b-4e2a-b4e1-20127f126832 tempest-VolumesNegativeTest-1596495973 tempest-VolumesNegativeTest-1596495973-project] HTTP exception thrown: Volume 5ac93427-af0b-47cb-a3e4-0079dc88ce27 could not be found. Sep 07 15:55:52.568676 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-78446f64-067b-4e2a-b4e1-20127f126832 tempest-VolumesNegativeTest-1596495973 tempest-VolumesNegativeTest-1596495973-project] Request method failure captured: Sep 07 15:55:52.568676 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: request: GET /compute/v2.1/os-volumes/5ac93427-af0b-47cb-a3e4-0079dc88ce27 HTTP/1.1 Sep 07 15:55:52.568676 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Accept: application/json Sep 07 15:55:52.568676 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Accept-Encoding: identity Sep 07 15:55:52.568676 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Connection: close Sep 07 15:55:52.568676 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Content-Length: 0 Sep 07 15:55:52.568676 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Content-Type: application/json Sep 07 15:55:52.568676 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Host: 10.222.0.17 Sep 07 15:55:52.568676 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Openstack-System-Scope: None Sep 07 15:55:52.568676 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Sep 07 15:55:52.568676 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjGL8GoVNFHa5TzLQm4zpPfyB1pTePzuQc5y6fYqTiJCMHvblDPpCxpbOTpkMDH79Nh0e3cL12k3cGNV6B8UBJXQl4xyBpe7ra4fE7UbwMzHx5Gu6-N3xt1UxjySLEkBEqjTLIVrvOn2edbIXeJ5xYWYFpYIqGqa0hQeJ9-emmUcxZHDQ Sep 07 15:55:52.568676 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Domain-Id: None Sep 07 15:55:52.568676 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Domain-Name: None Sep 07 15:55:52.568676 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Identity-Status: Confirmed Sep 07 15:55:52.568676 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Is-Admin-Project: True Sep 07 15:55:52.568676 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Domain-Id: default Sep 07 15:55:52.568676 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Domain-Name: Default Sep 07 15:55:52.568676 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Id: 2d357053af334b5090309eae0d444d95 Sep 07 15:55:52.568676 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Name: tempest-VolumesNegativeTest-1596495973 Sep 07 15:55:52.568676 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Role: reader,member Sep 07 15:55:52.568676 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Roles: reader,member Sep 07 15:55:52.570096 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2d357053af334b5090309eae0d444d95", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2d357053af334b5090309eae0d444d95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2d357053af334b5090309eae0d444d95"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2d357053af334b5090309eae0d444d95"}]}] Sep 07 15:55:52.570096 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant: tempest-VolumesNegativeTest-1596495973 Sep 07 15:55:52.570096 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant-Id: 2d357053af334b5090309eae0d444d95 Sep 07 15:55:52.570096 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant-Name: tempest-VolumesNegativeTest-1596495973 Sep 07 15:55:52.570096 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User: tempest-VolumesNegativeTest-1596495973-project Sep 07 15:55:52.570096 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Domain-Id: default Sep 07 15:55:52.570096 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Domain-Name: Default Sep 07 15:55:52.570096 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Id: 4feedcde86d04d2395b09ae65dee4ad9 Sep 07 15:55:52.570096 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Name: tempest-VolumesNegativeTest-1596495973-project Sep 07 15:55:52.570096 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: method: Sep 07 15:55:52.570096 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: exception: Volume 5ac93427-af0b-47cb-a3e4-0079dc88ce27 could not be found. Sep 07 15:55:52.570096 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: action_args: {'id': '5ac93427-af0b-47cb-a3e4-0079dc88ce27'} Sep 07 15:55:52.570096 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 15:55:52.570890 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:55:52.570890 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 15:55:52.570890 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 15:55:52.570890 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 15:55:52.570890 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 15:55:52.570890 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 15:55:52.570890 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 15:55:52.570890 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 15:55:52.570890 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 15:55:52.570890 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 15:55:52.570890 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 15:55:52.570890 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 15:55:52.570890 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 15:55:52.570890 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 15:55:52.570890 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 15:55:52.570890 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5ac93427-af0b-47cb-a3e4-0079dc88ce27 could not be found. (HTTP 404) (Request-ID: req-de1ba149-c67c-4f68-83ad-99e69fab0851) Sep 07 15:55:52.570890 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 15:55:52.570890 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 15:55:52.570890 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 15:55:52.572437 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:55:52.572437 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 07 15:55:52.572437 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 07 15:55:52.572437 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 15:55:52.572437 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 15:55:52.572437 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 15:55:52.572437 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 15:55:52.572437 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 15:55:52.572437 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 15:55:52.572437 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 15:55:52.572437 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 15:55:52.572437 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 15:55:52.572437 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 15:55:52.572437 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 15:55:52.572437 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 15:55:52.572437 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 15:55:52.572437 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 15:55:52.572437 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 15:55:52.572437 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 15:55:52.573535 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 15:55:52.573535 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 15:55:52.573535 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 15:55:52.573535 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 15:55:52.573535 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5ac93427-af0b-47cb-a3e4-0079dc88ce27 could not be found. Sep 07 15:55:52.573535 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 15:55:52.573535 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 15:55:52.573535 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 15:55:52.573535 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:55:52.573535 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 15:55:52.573535 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 15:55:52.573535 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 15:55:52.573535 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 15:55:52.573535 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 15:55:52.573535 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 15:55:52.573535 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 15:55:52.573535 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 15:55:52.573535 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 07 15:55:52.573535 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 15:55:52.574635 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5ac93427-af0b-47cb-a3e4-0079dc88ce27 could not be found. Sep 07 15:55:52.574635 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 15:55:52.574635 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 15:55:52.574635 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 15:55:52.574635 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:55:52.574635 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 15:55:52.574635 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 15:55:52.574635 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 15:55:52.574635 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 15:55:52.574635 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5ac93427-af0b-47cb-a3e4-0079dc88ce27 could not be found. Sep 07 15:55:52.574635 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 15:55:52.574635 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-78446f64-067b-4e2a-b4e1-20127f126832 tempest-VolumesNegativeTest-1596495973 tempest-VolumesNegativeTest-1596495973-project] Returning 404 to user: Volume 5ac93427-af0b-47cb-a3e4-0079dc88ce27 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 15:55:52.574635 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-78446f64-067b-4e2a-b4e1-20127f126832 tempest-VolumesNegativeTest-1596495973 tempest-VolumesNegativeTest-1596495973-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/5ac93427-af0b-47cb-a3e4-0079dc88ce27" status: 404 len: 109 microversion: 2.1 time: 0.170447 Sep 07 15:55:52.574635 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 3/10] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Sep 7 15:55:52 2022] GET /compute/v2.1/os-volumes/5ac93427-af0b-47cb-a3e4-0079dc88ce27 => generated 109 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 15:55:53.304882 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9d73383c-21d1-426a-826d-1f61df60ab73 tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] Calling method '.version_select at 0x7ff9a69af280>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:55:53.430231 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9d73383c-21d1-426a-826d-1f61df60ab73 tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/8c06b938-7008-4367-8861-723717c78131" status: 200 len: 345 microversion: 2.1 time: 0.131791 Sep 07 15:55:53.430784 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 8/11] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Sep 7 15:55:53 2022] GET /compute/v2.1/os-volumes/8c06b938-7008-4367-8861-723717c78131 => generated 345 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:55:53.444128 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d7abafcc-b1dc-4ab7-99cd-0e729b6ab37f tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] Action: 'create', calling method: .version_select at 0x7ff9a69f8af0>, body: {"snapshot": {"volume_id": "8c06b938-7008-4367-8861-723717c78131", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-309043477"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:55:53.762105 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d7abafcc-b1dc-4ab7-99cd-0e729b6ab37f tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] 10.222.0.17 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.321597 Sep 07 15:55:53.764228 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 4/12] 10.222.0.17 () {60 vars in 1162 bytes} [Wed Sep 7 15:55:53 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:55:53.774743 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-77fd3370-8b74-4c89-a027-df0d02405d4e tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] Calling method '.version_select at 0x7ff9a69af9d0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:55:54.021910 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-77fd3370-8b74-4c89-a027-df0d02405d4e tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/6a1c794e-3f72-4a6f-94b8-3eee377c10cb" status: 200 len: 286 microversion: 2.1 time: 0.251347 Sep 07 15:55:54.022793 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 9/13] 10.222.0.17 () {58 vars in 1251 bytes} [Wed Sep 7 15:55:53 2022] GET /compute/v2.1/os-snapshots/6a1c794e-3f72-4a6f-94b8-3eee377c10cb => generated 286 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:55:54.033824 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5b659ce4-370f-476e-8396-0b0b4d6b9aa0 tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] Calling method '.version_select at 0x7ff9a6a12ca0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:55:54.174691 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5b659ce4-370f-476e-8396-0b0b4d6b9aa0 tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.144620 Sep 07 15:55:54.182110 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 5/14] 10.222.0.17 () {58 vars in 1140 bytes} [Wed Sep 7 15:55:54 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:55:54.199973 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-487ed186-d01e-4941-a529-5598d7a8b93f tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] Calling method '.version_select at 0x7ff9a6a048b0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:55:54.251838 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-487ed186-d01e-4941-a529-5598d7a8b93f tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/6a1c794e-3f72-4a6f-94b8-3eee377c10cb" status: 200 len: 286 microversion: 2.1 time: 0.061274 Sep 07 15:55:54.257458 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 10/15] 10.222.0.17 () {58 vars in 1251 bytes} [Wed Sep 7 15:55:54 2022] GET /compute/v2.1/os-snapshots/6a1c794e-3f72-4a6f-94b8-3eee377c10cb => generated 286 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:55:55.266250 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3ec1fdc7-46f2-47ff-9282-806005e714dd tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] Calling method '.version_select at 0x7ff9a6a12790>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:55:55.370138 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3ec1fdc7-46f2-47ff-9282-806005e714dd tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/6a1c794e-3f72-4a6f-94b8-3eee377c10cb" status: 200 len: 286 microversion: 2.1 time: 0.108793 Sep 07 15:55:55.370981 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 6/16] 10.222.0.17 () {58 vars in 1251 bytes} [Wed Sep 7 15:55:55 2022] GET /compute/v2.1/os-snapshots/6a1c794e-3f72-4a6f-94b8-3eee377c10cb => generated 286 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:55:56.385497 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1beb5b14-9b82-447c-8f56-1edb9126bccf tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] Calling method '.version_select at 0x7ff9a69afd30>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:55:56.454783 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1beb5b14-9b82-447c-8f56-1edb9126bccf tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/6a1c794e-3f72-4a6f-94b8-3eee377c10cb" status: 200 len: 286 microversion: 2.1 time: 0.075330 Sep 07 15:55:56.455340 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 11/17] 10.222.0.17 () {58 vars in 1251 bytes} [Wed Sep 7 15:55:56 2022] GET /compute/v2.1/os-snapshots/6a1c794e-3f72-4a6f-94b8-3eee377c10cb => generated 286 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:55:57.468887 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-92bb904d-28fc-4149-912e-2c4047a588b7 tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] Calling method '.version_select at 0x7ff9a69f8550>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:55:57.534288 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-92bb904d-28fc-4149-912e-2c4047a588b7 tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/6a1c794e-3f72-4a6f-94b8-3eee377c10cb" status: 200 len: 286 microversion: 2.1 time: 0.069493 Sep 07 15:55:57.534845 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 7/18] 10.222.0.17 () {58 vars in 1251 bytes} [Wed Sep 7 15:55:57 2022] GET /compute/v2.1/os-snapshots/6a1c794e-3f72-4a6f-94b8-3eee377c10cb => generated 286 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:55:58.548274 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-594ed7ec-e479-484d-a363-22f5695fbffb tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] Calling method '.version_select at 0x7ff9a69af4c0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:55:58.617225 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-594ed7ec-e479-484d-a363-22f5695fbffb tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/6a1c794e-3f72-4a6f-94b8-3eee377c10cb" status: 200 len: 286 microversion: 2.1 time: 0.072905 Sep 07 15:55:58.618579 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 12/19] 10.222.0.17 () {58 vars in 1251 bytes} [Wed Sep 7 15:55:58 2022] GET /compute/v2.1/os-snapshots/6a1c794e-3f72-4a6f-94b8-3eee377c10cb => generated 286 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:55:59.632348 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0709b1d7-1ca6-4ea5-b989-3609e6b71f0b tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] Calling method '.version_select at 0x7ff9a69f8dc0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:55:59.702571 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0709b1d7-1ca6-4ea5-b989-3609e6b71f0b tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/6a1c794e-3f72-4a6f-94b8-3eee377c10cb" status: 200 len: 286 microversion: 2.1 time: 0.075095 Sep 07 15:55:59.703340 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 8/20] 10.222.0.17 () {58 vars in 1251 bytes} [Wed Sep 7 15:55:59 2022] GET /compute/v2.1/os-snapshots/6a1c794e-3f72-4a6f-94b8-3eee377c10cb => generated 286 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:56:00.725031 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ee802e56-7a67-4337-9c67-5ff6be182283 tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] Calling method '.version_select at 0x7ff9a69b7040>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:00.819398 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ee802e56-7a67-4337-9c67-5ff6be182283 tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/6a1c794e-3f72-4a6f-94b8-3eee377c10cb" status: 200 len: 286 microversion: 2.1 time: 0.104015 Sep 07 15:56:00.820669 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 13/21] 10.222.0.17 () {58 vars in 1251 bytes} [Wed Sep 7 15:56:00 2022] GET /compute/v2.1/os-snapshots/6a1c794e-3f72-4a6f-94b8-3eee377c10cb => generated 286 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:56:01.836841 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ac41007a-8c86-4999-86e0-07cbedfe4095 tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] Calling method '.version_select at 0x7ff9a69f8b80>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:01.890876 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ac41007a-8c86-4999-86e0-07cbedfe4095 tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/6a1c794e-3f72-4a6f-94b8-3eee377c10cb" status: 200 len: 287 microversion: 2.1 time: 0.061933 Sep 07 15:56:01.891943 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 9/22] 10.222.0.17 () {58 vars in 1251 bytes} [Wed Sep 7 15:56:01 2022] GET /compute/v2.1/os-snapshots/6a1c794e-3f72-4a6f-94b8-3eee377c10cb => generated 287 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:56:01.905812 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c252d04e-d388-426b-9ff4-30c96f99aa64 tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] Calling method '.version_select at 0x7ff9a69af1f0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:02.046534 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c252d04e-d388-426b-9ff4-30c96f99aa64 tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] 10.222.0.17 "DELETE /compute/v2.1/os-snapshots/6a1c794e-3f72-4a6f-94b8-3eee377c10cb" status: 202 len: 0 microversion: 2.1 time: 0.145092 Sep 07 15:56:02.047748 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 14/23] 10.222.0.17 () {58 vars in 1254 bytes} [Wed Sep 7 15:56:01 2022] DELETE /compute/v2.1/os-snapshots/6a1c794e-3f72-4a6f-94b8-3eee377c10cb => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 15:56:02.062627 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2f7b103f-4ad8-4f51-b699-279b79e75f63 tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] Calling method '.version_select at 0x7ff9a6a12b80>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:02.138107 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2f7b103f-4ad8-4f51-b699-279b79e75f63 tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/6a1c794e-3f72-4a6f-94b8-3eee377c10cb" status: 200 len: 286 microversion: 2.1 time: 0.084875 Sep 07 15:56:02.143277 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 10/24] 10.222.0.17 () {58 vars in 1251 bytes} [Wed Sep 7 15:56:02 2022] GET /compute/v2.1/os-snapshots/6a1c794e-3f72-4a6f-94b8-3eee377c10cb => generated 286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 15:56:03.156555 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-01a93816-a32d-4fb7-8c1a-3a9b3bf56818 tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] Calling method '.version_select at 0x7ff9a69afc10>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:03.430158 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-01a93816-a32d-4fb7-8c1a-3a9b3bf56818 tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] HTTP exception thrown: Snapshot 6a1c794e-3f72-4a6f-94b8-3eee377c10cb could not be found. Sep 07 15:56:03.433108 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-01a93816-a32d-4fb7-8c1a-3a9b3bf56818 tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] Request method failure captured: Sep 07 15:56:03.433108 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: request: GET /compute/v2.1/os-snapshots/6a1c794e-3f72-4a6f-94b8-3eee377c10cb HTTP/1.1 Sep 07 15:56:03.433108 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept: application/json Sep 07 15:56:03.433108 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Sep 07 15:56:03.433108 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Connection: close Sep 07 15:56:03.433108 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Length: 0 Sep 07 15:56:03.433108 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Type: application/json Sep 07 15:56:03.433108 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Host: 10.222.0.17 Sep 07 15:56:03.433108 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Sep 07 15:56:03.433108 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Sep 07 15:56:03.433108 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjGL8EFsJT0pN_M_soDnZ7rmT1qNGJE-4qsTMyNiem2UOopSz3mbfOvA4DKKWpFHOTcx_R1uvA6Gktp5OTgONM6PWAWXtYmvilq1KV4_9InZLIWc4lii4GSK9nIsexmpWofVKr8IfVG2IjWFPHh-D8_oxSCnlDUYS3oxUXQxCG4ZzWTpw Sep 07 15:56:03.433108 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Sep 07 15:56:03.433108 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Sep 07 15:56:03.433108 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Sep 07 15:56:03.433108 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Sep 07 15:56:03.433108 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Sep 07 15:56:03.433108 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Sep 07 15:56:03.433108 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Id: d1416faa95b24d76b2189a0cf79e3389 Sep 07 15:56:03.433108 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-530902128 Sep 07 15:56:03.433108 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Role: reader,member Sep 07 15:56:03.433108 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Roles: reader,member Sep 07 15:56:03.434216 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d1416faa95b24d76b2189a0cf79e3389", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d1416faa95b24d76b2189a0cf79e3389"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d1416faa95b24d76b2189a0cf79e3389"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d1416faa95b24d76b2189a0cf79e3389"}]}] Sep 07 15:56:03.434216 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-VolumesSnapshotsTestJSON-530902128 Sep 07 15:56:03.434216 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Id: d1416faa95b24d76b2189a0cf79e3389 Sep 07 15:56:03.434216 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-530902128 Sep 07 15:56:03.434216 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User: tempest-VolumesSnapshotsTestJSON-530902128-project Sep 07 15:56:03.434216 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Sep 07 15:56:03.434216 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Sep 07 15:56:03.434216 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Id: 53642660b6584d5e89f8e3e9c0d3a301 Sep 07 15:56:03.434216 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-VolumesSnapshotsTestJSON-530902128-project Sep 07 15:56:03.434216 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: method: Sep 07 15:56:03.434216 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: exception: Snapshot 6a1c794e-3f72-4a6f-94b8-3eee377c10cb could not be found. Sep 07 15:56:03.434216 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: action_args: {'id': '6a1c794e-3f72-4a6f-94b8-3eee377c10cb'} Sep 07 15:56:03.434216 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 15:56:03.434904 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:56:03.434904 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 07 15:56:03.434904 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 07 15:56:03.434904 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 07 15:56:03.434904 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 07 15:56:03.434904 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 07 15:56:03.434904 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 07 15:56:03.434904 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 15:56:03.434904 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 15:56:03.434904 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 15:56:03.434904 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 15:56:03.434904 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 15:56:03.434904 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 15:56:03.434904 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 15:56:03.434904 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 15:56:03.434904 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 6a1c794e-3f72-4a6f-94b8-3eee377c10cb could not be found. (HTTP 404) (Request-ID: req-f2572026-1774-4d1e-847f-ee9e1d6cff4d) Sep 07 15:56:03.434904 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:56:03.434904 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 15:56:03.435907 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:56:03.435907 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:56:03.435907 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 07 15:56:03.435907 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 07 15:56:03.435907 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 15:56:03.435907 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 15:56:03.435907 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 07 15:56:03.435907 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 07 15:56:03.435907 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 15:56:03.435907 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 15:56:03.435907 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 07 15:56:03.435907 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 07 15:56:03.435907 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 07 15:56:03.435907 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 07 15:56:03.435907 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 07 15:56:03.435907 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 07 15:56:03.435907 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 15:56:03.435907 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 15:56:03.435907 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 15:56:03.436941 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 15:56:03.436941 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 15:56:03.436941 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 15:56:03.436941 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 15:56:03.436941 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 15:56:03.436941 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 6a1c794e-3f72-4a6f-94b8-3eee377c10cb could not be found. Sep 07 15:56:03.436941 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:56:03.436941 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 15:56:03.436941 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:56:03.436941 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:56:03.436941 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 15:56:03.436941 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 15:56:03.436941 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 15:56:03.436941 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 15:56:03.436941 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 15:56:03.436941 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 15:56:03.436941 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 15:56:03.436941 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 15:56:03.436941 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 07 15:56:03.436941 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 15:56:03.438295 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 6a1c794e-3f72-4a6f-94b8-3eee377c10cb could not be found. Sep 07 15:56:03.438295 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:56:03.438295 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 15:56:03.438295 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:56:03.438295 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:56:03.438295 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 15:56:03.438295 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 15:56:03.438295 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 15:56:03.438295 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 15:56:03.438295 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 6a1c794e-3f72-4a6f-94b8-3eee377c10cb could not be found. Sep 07 15:56:03.438295 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:56:03.439757 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-01a93816-a32d-4fb7-8c1a-3a9b3bf56818 tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] Returning 404 to user: Snapshot 6a1c794e-3f72-4a6f-94b8-3eee377c10cb could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 15:56:03.440879 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-01a93816-a32d-4fb7-8c1a-3a9b3bf56818 tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/6a1c794e-3f72-4a6f-94b8-3eee377c10cb" status: 404 len: 111 microversion: 2.1 time: 0.291597 Sep 07 15:56:03.441624 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 15/25] 10.222.0.17 () {58 vars in 1251 bytes} [Wed Sep 7 15:56:03 2022] GET /compute/v2.1/os-snapshots/6a1c794e-3f72-4a6f-94b8-3eee377c10cb => generated 111 bytes in 293 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 15:56:03.449957 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6470b541-74db-440a-a38f-dd3ef08272ca tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] Calling method '.version_select at 0x7ff9a6a124c0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:03.775095 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6470b541-74db-440a-a38f-dd3ef08272ca tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/8c06b938-7008-4367-8861-723717c78131" status: 202 len: 0 microversion: 2.1 time: 0.329035 Sep 07 15:56:03.775968 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 11/26] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Sep 7 15:56:03 2022] DELETE /compute/v2.1/os-volumes/8c06b938-7008-4367-8861-723717c78131 => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 15:56:03.786833 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-417fcf99-e308-43e5-9502-02bb1fb22bd0 tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] Calling method '.version_select at 0x7ff9a73ef940>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:04.072837 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3c77871f-1000-42f4-874b-dbf7fb32a4fc tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1443272947", "imageRef": "cfe19284-9779-46f4-b458-81d5475ec82f", "flavorRef": "452", "networks": [{"uuid": "84f5df43-292b-42a4-8fa3-ce594a432b48"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:56:04.143285 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-417fcf99-e308-43e5-9502-02bb1fb22bd0 tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/8c06b938-7008-4367-8861-723717c78131" status: 200 len: 344 microversion: 2.1 time: 0.362356 Sep 07 15:56:04.148025 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 12/27] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Sep 7 15:56:03 2022] GET /compute/v2.1/os-volumes/8c06b938-7008-4367-8861-723717c78131 => generated 344 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:56:04.270051 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-3c77871f-1000-42f4-874b-dbf7fb32a4fc tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] validate_networks() for [('84f5df43-292b-42a4-8fa3-ce594a432b48', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 15:56:04.975811 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6fca9d82-6245-4d1d-9e09-5c440cc5add8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Action: 'create', calling method: .version_select at 0x7ff9a6a123a0>, body: {"keypair": {"name": "tempest-keypair-204181710", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOKPKfTjuz5yo+E6semaPRVWhDdCOpMsESHTw0p/2CT5qrrX9aI94eY+hCo49xMrO5fAx2r4dEO2R9Xu0S2QvnRWFOytXG0kcXRvjplYMLxmIblC1Kv98e7ZTfzpnkwacA=="}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:56:05.048678 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.quota [None req-6fca9d82-6245-4d1d-9e09-5c440cc5add8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Getting quotas for project 64aae5509a124aebbb92ff5dc82e90cf. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 15:56:05.058521 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.quota [None req-6fca9d82-6245-4d1d-9e09-5c440cc5add8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Getting quotas for user d7e96593e2814e8b9f7c0f320aa17c3c and project 64aae5509a124aebbb92ff5dc82e90cf. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 15:56:05.166604 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6fca9d82-6245-4d1d-9e09-5c440cc5add8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.294283 Sep 07 15:56:05.177127 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 13/28] 10.222.0.17 () {62 vars in 1200 bytes} [Wed Sep 7 15:56:04 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 306 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 07 15:56:05.311881 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9ac7bb31-d72a-41ce-a353-11994f0c2b3d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-438936019", "imageRef": "cfe19284-9779-46f4-b458-81d5475ec82f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:56:05.476834 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-9ac7bb31-d72a-41ce-a353-11994f0c2b3d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] validate_networks() for [('230587ed-e651-463c-bff3-6daa9b0897e1', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 15:56:05.762064 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-3c77871f-1000-42f4-874b-dbf7fb32a4fc tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 15:56:05.762597 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-3c77871f-1000-42f4-874b-dbf7fb32a4fc tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 15:56:05.762960 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-3c77871f-1000-42f4-874b-dbf7fb32a4fc tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 15:56:05.763368 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-3c77871f-1000-42f4-874b-dbf7fb32a4fc tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 15:56:05.763797 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-3c77871f-1000-42f4-874b-dbf7fb32a4fc tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 15:56:05.793414 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c77871f-1000-42f4-874b-dbf7fb32a4fc tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:05.794022 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c77871f-1000-42f4-874b-dbf7fb32a4fc tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:05.794413 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c77871f-1000-42f4-874b-dbf7fb32a4fc tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:05.795137 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c77871f-1000-42f4-874b-dbf7fb32a4fc tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:05.795636 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c77871f-1000-42f4-874b-dbf7fb32a4fc tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:05.798020 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3c77871f-1000-42f4-874b-dbf7fb32a4fc tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:05.876166 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-3c77871f-1000-42f4-874b-dbf7fb32a4fc tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Getting quotas for project 5d24ce688df84f049775fa082eefcdce. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 15:56:05.890919 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-3c77871f-1000-42f4-874b-dbf7fb32a4fc tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Getting quotas for user de43a221bd8148b39eabc978b97f0e2a and project 5d24ce688df84f049775fa082eefcdce. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 15:56:05.920728 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3c77871f-1000-42f4-874b-dbf7fb32a4fc tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 15:56:05.930822 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3c77871f-1000-42f4-874b-dbf7fb32a4fc tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cfe19284-9779-46f4-b458-81d5475ec82f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 15:56:06.088288 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3c77871f-1000-42f4-874b-dbf7fb32a4fc tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.394466 Sep 07 15:56:06.088931 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 16/29] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Sep 7 15:56:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2396 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 07 15:56:06.103734 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1a514853-e13c-4fad-97f3-4caf0344d47d tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] Calling method '.version_select at 0x7ff9a60bd700>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:06.167697 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1a514853-e13c-4fad-97f3-4caf0344d47d tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/8c06b938-7008-4367-8861-723717c78131" status: 200 len: 344 microversion: 2.1 time: 0.077035 Sep 07 15:56:06.168671 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 17/30] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Sep 7 15:56:06 2022] GET /compute/v2.1/os-volumes/8c06b938-7008-4367-8861-723717c78131 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:56:06.175171 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6d8b8f65-08ca-474b-af11-822f0c4b8bc6 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:06.176063 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6d8b8f65-08ca-474b-af11-822f0c4b8bc6 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:06.323850 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6d8b8f65-08ca-474b-af11-822f0c4b8bc6 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:06.359699 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6d8b8f65-08ca-474b-af11-822f0c4b8bc6 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1215 microversion: 2.1 time: 0.189695 Sep 07 15:56:06.360882 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 18/31] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:06 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1215 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:06.745122 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-9ac7bb31-d72a-41ce-a353-11994f0c2b3d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 15:56:06.745694 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-9ac7bb31-d72a-41ce-a353-11994f0c2b3d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 15:56:06.746113 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-9ac7bb31-d72a-41ce-a353-11994f0c2b3d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 15:56:06.746757 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-9ac7bb31-d72a-41ce-a353-11994f0c2b3d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 15:56:06.747365 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-9ac7bb31-d72a-41ce-a353-11994f0c2b3d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 15:56:06.765953 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9ac7bb31-d72a-41ce-a353-11994f0c2b3d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:06.766480 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9ac7bb31-d72a-41ce-a353-11994f0c2b3d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:06.766924 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9ac7bb31-d72a-41ce-a353-11994f0c2b3d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:06.767691 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9ac7bb31-d72a-41ce-a353-11994f0c2b3d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:06.768150 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9ac7bb31-d72a-41ce-a353-11994f0c2b3d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:06.768699 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9ac7bb31-d72a-41ce-a353-11994f0c2b3d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:06.801103 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.quota [None req-9ac7bb31-d72a-41ce-a353-11994f0c2b3d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Getting quotas for project 20596aac52254a159269aa634116f080. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 15:56:06.806569 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.quota [None req-9ac7bb31-d72a-41ce-a353-11994f0c2b3d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Getting quotas for user 7dc84ece6eb84315b54defd89be8a95c and project 20596aac52254a159269aa634116f080. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 15:56:06.824853 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9ac7bb31-d72a-41ce-a353-11994f0c2b3d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 15:56:06.830984 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9ac7bb31-d72a-41ce-a353-11994f0c2b3d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: f39427e6-62a5-4a4e-96e8-644f03653722] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cfe19284-9779-46f4-b458-81d5475ec82f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 15:56:06.946483 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9ac7bb31-d72a-41ce-a353-11994f0c2b3d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.767913 Sep 07 15:56:06.947989 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 14/32] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Sep 7 15:56:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 1770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 15:56:06.960372 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f4550799-e834-48a5-8935-cc08d199fa26 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:06.961005 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f4550799-e834-48a5-8935-cc08d199fa26 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: f39427e6-62a5-4a4e-96e8-644f03653722] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:07.183023 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4d409576-f3ff-42bd-b196-8f2d513ef118 tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] Calling method '.version_select at 0x7ff9a68c5700>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:07.230824 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f4550799-e834-48a5-8935-cc08d199fa26 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:07.238898 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f4550799-e834-48a5-8935-cc08d199fa26 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722" status: 200 len: 1221 microversion: 2.1 time: 0.282542 Sep 07 15:56:07.246266 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 19/33] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:06 2022] GET /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722 => generated 1221 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:07.278702 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4d409576-f3ff-42bd-b196-8f2d513ef118 tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/8c06b938-7008-4367-8861-723717c78131" status: 200 len: 344 microversion: 2.1 time: 0.099774 Sep 07 15:56:07.279692 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 15/34] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Sep 7 15:56:07 2022] GET /compute/v2.1/os-volumes/8c06b938-7008-4367-8861-723717c78131 => generated 344 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 15:56:07.337956 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5573021e-26c6-4da6-a574-d145253b6346 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1355627758", "imageRef": "cfe19284-9779-46f4-b458-81d5475ec82f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:56:07.391977 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-20c0fc50-6ef8-4812-82f6-f3e042eca8f3 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:07.395093 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-20c0fc50-6ef8-4812-82f6-f3e042eca8f3 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:07.482582 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-5573021e-26c6-4da6-a574-d145253b6346 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] validate_networks() for [('230587ed-e651-463c-bff3-6daa9b0897e1', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 15:56:07.596913 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-20c0fc50-6ef8-4812-82f6-f3e042eca8f3 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:07.619483 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-20c0fc50-6ef8-4812-82f6-f3e042eca8f3 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1215 microversion: 2.1 time: 0.237961 Sep 07 15:56:07.620612 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 16/35] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:07 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1215 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:56:08.294400 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c9aab8b4-bc31-482b-9768-23c8e82dc0c5 tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] Calling method '.version_select at 0x7ff9a68c5940>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:08.401773 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c9aab8b4-bc31-482b-9768-23c8e82dc0c5 tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/8c06b938-7008-4367-8861-723717c78131" status: 200 len: 344 microversion: 2.1 time: 0.111646 Sep 07 15:56:08.409402 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 17/36] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Sep 7 15:56:08 2022] GET /compute/v2.1/os-volumes/8c06b938-7008-4367-8861-723717c78131 => generated 344 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 15:56:08.658193 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6f9b707e-0d83-40d7-b2e7-facbafbe0bdc tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:08.658907 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6f9b707e-0d83-40d7-b2e7-facbafbe0bdc tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:08.667748 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f9b707e-0d83-40d7-b2e7-facbafbe0bdc tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:08.676395 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f9b707e-0d83-40d7-b2e7-facbafbe0bdc tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:08.676853 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f9b707e-0d83-40d7-b2e7-facbafbe0bdc tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:08.677599 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f9b707e-0d83-40d7-b2e7-facbafbe0bdc tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:08.678063 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f9b707e-0d83-40d7-b2e7-facbafbe0bdc tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:08.684314 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f9b707e-0d83-40d7-b2e7-facbafbe0bdc tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:08.815165 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-5573021e-26c6-4da6-a574-d145253b6346 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 15:56:08.818348 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-5573021e-26c6-4da6-a574-d145253b6346 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 15:56:08.819027 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-5573021e-26c6-4da6-a574-d145253b6346 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 15:56:08.819441 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-5573021e-26c6-4da6-a574-d145253b6346 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 15:56:08.819888 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-5573021e-26c6-4da6-a574-d145253b6346 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 15:56:08.828827 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5573021e-26c6-4da6-a574-d145253b6346 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:08.829475 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5573021e-26c6-4da6-a574-d145253b6346 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:08.835054 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5573021e-26c6-4da6-a574-d145253b6346 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:08.836019 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5573021e-26c6-4da6-a574-d145253b6346 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:08.836631 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5573021e-26c6-4da6-a574-d145253b6346 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:08.837246 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5573021e-26c6-4da6-a574-d145253b6346 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:08.867034 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-5573021e-26c6-4da6-a574-d145253b6346 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Getting quotas for project 20596aac52254a159269aa634116f080. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 15:56:08.871294 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-5573021e-26c6-4da6-a574-d145253b6346 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Getting quotas for user 7dc84ece6eb84315b54defd89be8a95c and project 20596aac52254a159269aa634116f080. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 15:56:08.889661 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5573021e-26c6-4da6-a574-d145253b6346 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 15:56:08.892065 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5573021e-26c6-4da6-a574-d145253b6346 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cfe19284-9779-46f4-b458-81d5475ec82f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 15:56:08.973934 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-6f9b707e-0d83-40d7-b2e7-facbafbe0bdc tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:08.988261 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6f9b707e-0d83-40d7-b2e7-facbafbe0bdc tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1211 microversion: 2.1 time: 0.335736 Sep 07 15:56:08.989129 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 18/37] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:08 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1211 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:09.014958 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5573021e-26c6-4da6-a574-d145253b6346 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.686370 Sep 07 15:56:09.022485 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 20/38] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Sep 7 15:56:07 2022] POST /compute/v2.1/servers => generated 383 bytes in 1689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 15:56:09.028727 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7b2c9eb3-1eba-4f9a-822a-13b39bdfd0cb tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:09.029344 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7b2c9eb3-1eba-4f9a-822a-13b39bdfd0cb tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:09.152368 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-7b2c9eb3-1eba-4f9a-822a-13b39bdfd0cb tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:09.185299 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7b2c9eb3-1eba-4f9a-822a-13b39bdfd0cb tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1222 microversion: 2.1 time: 0.159945 Sep 07 15:56:09.196425 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 19/39] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:09 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1222 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:09.419036 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dfd6bb11-c87d-4c74-a862-344075d5a7e0 tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] Calling method '.version_select at 0x7ff9a6070e50>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:09.502661 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dfd6bb11-c87d-4c74-a862-344075d5a7e0 tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/8c06b938-7008-4367-8861-723717c78131" status: 200 len: 344 microversion: 2.1 time: 0.089794 Sep 07 15:56:09.510504 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 21/40] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Sep 7 15:56:09 2022] GET /compute/v2.1/os-volumes/8c06b938-7008-4367-8861-723717c78131 => generated 344 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:56:09.636474 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3fea2787-edb0-4c0a-9bb2-7915acfb838e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-701037073", "imageRef": "cfe19284-9779-46f4-b458-81d5475ec82f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f7642c8d-f0b1-421f-82e8-106c8c8a5121"}], "security_groups": [{"name": "tempest-securitygroup--1159475816"}], "key_name": "tempest-keypair-204181710", "user_data": "}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:56:09.792865 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-3fea2787-edb0-4c0a-9bb2-7915acfb838e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] validate_networks() for [('f7642c8d-f0b1-421f-82e8-106c8c8a5121', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 15:56:10.014937 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9dfacb96-e50c-4cdb-8c45-3eaadf3e2308 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:10.015692 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9dfacb96-e50c-4cdb-8c45-3eaadf3e2308 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:10.032446 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9dfacb96-e50c-4cdb-8c45-3eaadf3e2308 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:10.032936 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9dfacb96-e50c-4cdb-8c45-3eaadf3e2308 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:10.033372 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9dfacb96-e50c-4cdb-8c45-3eaadf3e2308 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:10.034072 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9dfacb96-e50c-4cdb-8c45-3eaadf3e2308 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:10.035024 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9dfacb96-e50c-4cdb-8c45-3eaadf3e2308 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:10.035568 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9dfacb96-e50c-4cdb-8c45-3eaadf3e2308 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:10.193347 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9dfacb96-e50c-4cdb-8c45-3eaadf3e2308 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:10.207294 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9dfacb96-e50c-4cdb-8c45-3eaadf3e2308 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1211 microversion: 2.1 time: 0.196410 Sep 07 15:56:10.223261 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 22/41] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:10 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1211 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:10.223261 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-13e3c84c-2dd3-4982-a669-128c733f4f95 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:10.223261 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-13e3c84c-2dd3-4982-a669-128c733f4f95 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:10.227887 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-3fea2787-edb0-4c0a-9bb2-7915acfb838e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 15:56:10.228160 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-13e3c84c-2dd3-4982-a669-128c733f4f95 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:10.228476 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-3fea2787-edb0-4c0a-9bb2-7915acfb838e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 15:56:10.229011 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-3fea2787-edb0-4c0a-9bb2-7915acfb838e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 15:56:10.229101 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-13e3c84c-2dd3-4982-a669-128c733f4f95 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:10.229516 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-3fea2787-edb0-4c0a-9bb2-7915acfb838e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 15:56:10.229829 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-13e3c84c-2dd3-4982-a669-128c733f4f95 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:10.230228 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-3fea2787-edb0-4c0a-9bb2-7915acfb838e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 15:56:10.231136 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-13e3c84c-2dd3-4982-a669-128c733f4f95 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:10.232012 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-13e3c84c-2dd3-4982-a669-128c733f4f95 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:10.233232 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-13e3c84c-2dd3-4982-a669-128c733f4f95 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:10.240178 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3fea2787-edb0-4c0a-9bb2-7915acfb838e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:10.240817 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3fea2787-edb0-4c0a-9bb2-7915acfb838e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:10.241347 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3fea2787-edb0-4c0a-9bb2-7915acfb838e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:10.242200 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3fea2787-edb0-4c0a-9bb2-7915acfb838e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:10.242867 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3fea2787-edb0-4c0a-9bb2-7915acfb838e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:10.243455 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3fea2787-edb0-4c0a-9bb2-7915acfb838e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:10.261834 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.quota [None req-3fea2787-edb0-4c0a-9bb2-7915acfb838e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Getting quotas for project 64aae5509a124aebbb92ff5dc82e90cf. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 15:56:10.265829 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.quota [None req-3fea2787-edb0-4c0a-9bb2-7915acfb838e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Getting quotas for user d7e96593e2814e8b9f7c0f320aa17c3c and project 64aae5509a124aebbb92ff5dc82e90cf. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 15:56:10.278743 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3fea2787-edb0-4c0a-9bb2-7915acfb838e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 15:56:10.281584 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3fea2787-edb0-4c0a-9bb2-7915acfb838e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cfe19284-9779-46f4-b458-81d5475ec82f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 15:56:10.314843 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-13e3c84c-2dd3-4982-a669-128c733f4f95 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:10.330545 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-13e3c84c-2dd3-4982-a669-128c733f4f95 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1226 microversion: 2.1 time: 0.116409 Sep 07 15:56:10.331136 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 23/42] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:10 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1226 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:10.347296 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3fea2787-edb0-4c0a-9bb2-7915acfb838e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.716421 Sep 07 15:56:10.348984 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 20/43] 10.222.0.17 () {62 vars in 1188 bytes} [Wed Sep 7 15:56:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 07 15:56:10.360648 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b6c0c3de-ee81-4a04-9fc1-76912c5ce9cd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:10.361272 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b6c0c3de-ee81-4a04-9fc1-76912c5ce9cd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:10.435410 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b6c0c3de-ee81-4a04-9fc1-76912c5ce9cd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:10.449042 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b6c0c3de-ee81-4a04-9fc1-76912c5ce9cd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:10.451088 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b6c0c3de-ee81-4a04-9fc1-76912c5ce9cd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:10.452808 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b6c0c3de-ee81-4a04-9fc1-76912c5ce9cd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1280 microversion: 2.20 time: 0.095696 Sep 07 15:56:10.453864 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 24/44] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:56:10 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1280 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:56:10.517234 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a372a21a-1795-434a-ac0d-e1014f64499d tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] Calling method '.version_select at 0x7ff9a600daf0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:10.568836 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a372a21a-1795-434a-ac0d-e1014f64499d tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/8c06b938-7008-4367-8861-723717c78131" status: 200 len: 344 microversion: 2.1 time: 0.055510 Sep 07 15:56:10.569480 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 21/45] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Sep 7 15:56:10 2022] GET /compute/v2.1/os-volumes/8c06b938-7008-4367-8861-723717c78131 => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:56:11.234477 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f294bdf5-29c7-4f8e-84f6-f91cd46f2568 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:11.235450 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f294bdf5-29c7-4f8e-84f6-f91cd46f2568 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:11.245239 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f294bdf5-29c7-4f8e-84f6-f91cd46f2568 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:11.246015 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f294bdf5-29c7-4f8e-84f6-f91cd46f2568 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:11.246706 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f294bdf5-29c7-4f8e-84f6-f91cd46f2568 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:11.248144 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f294bdf5-29c7-4f8e-84f6-f91cd46f2568 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:11.248866 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f294bdf5-29c7-4f8e-84f6-f91cd46f2568 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:11.249550 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f294bdf5-29c7-4f8e-84f6-f91cd46f2568 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:11.314627 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f294bdf5-29c7-4f8e-84f6-f91cd46f2568 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:11.323057 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f294bdf5-29c7-4f8e-84f6-f91cd46f2568 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1211 microversion: 2.1 time: 0.094537 Sep 07 15:56:11.324284 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 25/46] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:11 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1211 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:56:11.354575 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a3ffbd3b-d4e6-43a2-8a5d-742014f0fbb7 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:11.355205 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a3ffbd3b-d4e6-43a2-8a5d-742014f0fbb7 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:11.361816 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3ffbd3b-d4e6-43a2-8a5d-742014f0fbb7 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:11.362708 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3ffbd3b-d4e6-43a2-8a5d-742014f0fbb7 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:11.363148 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3ffbd3b-d4e6-43a2-8a5d-742014f0fbb7 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:11.363866 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3ffbd3b-d4e6-43a2-8a5d-742014f0fbb7 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:11.364324 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3ffbd3b-d4e6-43a2-8a5d-742014f0fbb7 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:11.364950 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3ffbd3b-d4e6-43a2-8a5d-742014f0fbb7 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:11.426538 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-a3ffbd3b-d4e6-43a2-8a5d-742014f0fbb7 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:11.434306 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a3ffbd3b-d4e6-43a2-8a5d-742014f0fbb7 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1226 microversion: 2.1 time: 0.083915 Sep 07 15:56:11.434880 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 22/47] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:11 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:11.482501 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3a1d8c9e-b104-4222-bef6-edcf6ba08f5a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:11.483363 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3a1d8c9e-b104-4222-bef6-edcf6ba08f5a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:11.491925 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a1d8c9e-b104-4222-bef6-edcf6ba08f5a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:11.492431 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a1d8c9e-b104-4222-bef6-edcf6ba08f5a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:11.492875 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a1d8c9e-b104-4222-bef6-edcf6ba08f5a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:11.493718 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a1d8c9e-b104-4222-bef6-edcf6ba08f5a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:11.495383 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a1d8c9e-b104-4222-bef6-edcf6ba08f5a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:11.495998 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a1d8c9e-b104-4222-bef6-edcf6ba08f5a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:11.571169 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3a1d8c9e-b104-4222-bef6-edcf6ba08f5a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:11.582616 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3a1d8c9e-b104-4222-bef6-edcf6ba08f5a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:11.584283 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3a1d8c9e-b104-4222-bef6-edcf6ba08f5a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:11.585414 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3a1d8c9e-b104-4222-bef6-edcf6ba08f5a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1284 microversion: 2.20 time: 0.107053 Sep 07 15:56:11.585550 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3b0cb963-39b5-4c25-a8c8-01962cf9d7eb tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] Calling method '.version_select at 0x7ff9a606e9d0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:11.586590 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 26/48] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:56:11 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:56:11.641131 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3b0cb963-39b5-4c25-a8c8-01962cf9d7eb tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/8c06b938-7008-4367-8861-723717c78131" status: 200 len: 344 microversion: 2.1 time: 0.061693 Sep 07 15:56:11.642225 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 23/49] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Sep 7 15:56:11 2022] GET /compute/v2.1/os-volumes/8c06b938-7008-4367-8861-723717c78131 => generated 344 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 15:56:12.346147 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-35b7456f-f79b-44d5-8d3a-c7545b17fcb8 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:12.346759 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-35b7456f-f79b-44d5-8d3a-c7545b17fcb8 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:12.353751 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35b7456f-f79b-44d5-8d3a-c7545b17fcb8 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:12.354307 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35b7456f-f79b-44d5-8d3a-c7545b17fcb8 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:12.354804 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35b7456f-f79b-44d5-8d3a-c7545b17fcb8 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:12.355580 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35b7456f-f79b-44d5-8d3a-c7545b17fcb8 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:12.356121 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35b7456f-f79b-44d5-8d3a-c7545b17fcb8 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:12.356633 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35b7456f-f79b-44d5-8d3a-c7545b17fcb8 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:12.422911 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-35b7456f-f79b-44d5-8d3a-c7545b17fcb8 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:12.430983 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-35b7456f-f79b-44d5-8d3a-c7545b17fcb8 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1267 microversion: 2.1 time: 0.088655 Sep 07 15:56:12.431533 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 27/50] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:12 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1267 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:12.456905 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f00231f0-3ece-43f6-a3a9-bc0574e7f2e9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:12.457522 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f00231f0-3ece-43f6-a3a9-bc0574e7f2e9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:12.463418 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f00231f0-3ece-43f6-a3a9-bc0574e7f2e9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:12.463932 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f00231f0-3ece-43f6-a3a9-bc0574e7f2e9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:12.464371 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f00231f0-3ece-43f6-a3a9-bc0574e7f2e9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:12.465055 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f00231f0-3ece-43f6-a3a9-bc0574e7f2e9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:12.465510 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f00231f0-3ece-43f6-a3a9-bc0574e7f2e9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:12.465933 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f00231f0-3ece-43f6-a3a9-bc0574e7f2e9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:12.526616 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-f00231f0-3ece-43f6-a3a9-bc0574e7f2e9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:12.534343 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f00231f0-3ece-43f6-a3a9-bc0574e7f2e9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1218 microversion: 2.1 time: 0.081233 Sep 07 15:56:12.535025 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 24/51] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:12 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:56:12.612309 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1f68ef9c-6741-4184-af9a-bb2565c82d8f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:12.612917 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1f68ef9c-6741-4184-af9a-bb2565c82d8f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:12.619123 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f68ef9c-6741-4184-af9a-bb2565c82d8f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:12.619675 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f68ef9c-6741-4184-af9a-bb2565c82d8f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:12.620121 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f68ef9c-6741-4184-af9a-bb2565c82d8f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:12.620834 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f68ef9c-6741-4184-af9a-bb2565c82d8f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:12.621287 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f68ef9c-6741-4184-af9a-bb2565c82d8f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:12.621713 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f68ef9c-6741-4184-af9a-bb2565c82d8f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:12.656189 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fb9f30b5-04fa-4376-b1a0-8184ab64b5f8 tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] Calling method '.version_select at 0x7ff9a5ffdd30>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:12.699740 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1f68ef9c-6741-4184-af9a-bb2565c82d8f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:12.708734 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fb9f30b5-04fa-4376-b1a0-8184ab64b5f8 tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/8c06b938-7008-4367-8861-723717c78131" status: 200 len: 344 microversion: 2.1 time: 0.056519 Sep 07 15:56:12.709495 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 25/52] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Sep 7 15:56:12 2022] GET /compute/v2.1/os-volumes/8c06b938-7008-4367-8861-723717c78131 => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 15:56:12.716844 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1f68ef9c-6741-4184-af9a-bb2565c82d8f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:12.718436 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1f68ef9c-6741-4184-af9a-bb2565c82d8f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:12.719587 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1f68ef9c-6741-4184-af9a-bb2565c82d8f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1276 microversion: 2.20 time: 0.111253 Sep 07 15:56:12.720328 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 28/53] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:56:12 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1276 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:56:13.452322 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8a5561a2-ee07-47e4-b3d9-d5b16c9ca67a tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:13.452971 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8a5561a2-ee07-47e4-b3d9-d5b16c9ca67a tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:13.468349 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a5561a2-ee07-47e4-b3d9-d5b16c9ca67a tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:13.469535 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a5561a2-ee07-47e4-b3d9-d5b16c9ca67a tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:13.469973 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a5561a2-ee07-47e4-b3d9-d5b16c9ca67a tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:13.470667 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a5561a2-ee07-47e4-b3d9-d5b16c9ca67a tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:13.471261 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a5561a2-ee07-47e4-b3d9-d5b16c9ca67a tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:13.471716 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8a5561a2-ee07-47e4-b3d9-d5b16c9ca67a tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:13.557842 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b813244a-be02-433f-8a06-a551ab23e094 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:13.558814 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b813244a-be02-433f-8a06-a551ab23e094 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:13.567262 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b813244a-be02-433f-8a06-a551ab23e094 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:13.570338 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b813244a-be02-433f-8a06-a551ab23e094 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:13.570824 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b813244a-be02-433f-8a06-a551ab23e094 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:13.575222 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-8a5561a2-ee07-47e4-b3d9-d5b16c9ca67a tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:13.583418 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8a5561a2-ee07-47e4-b3d9-d5b16c9ca67a tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1273 microversion: 2.1 time: 0.134758 Sep 07 15:56:13.585753 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b813244a-be02-433f-8a06-a551ab23e094 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:13.588413 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 26/54] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:13 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1273 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:13.588563 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b813244a-be02-433f-8a06-a551ab23e094 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:13.597564 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b813244a-be02-433f-8a06-a551ab23e094 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:13.727942 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d7862f94-7963-4add-8261-1b9c530fbc80 tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] Calling method '.version_select at 0x7ff9a5ff5430>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:13.739574 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b813244a-be02-433f-8a06-a551ab23e094 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:13.752818 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b813244a-be02-433f-8a06-a551ab23e094 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1218 microversion: 2.1 time: 0.198735 Sep 07 15:56:13.753919 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 29/55] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:13 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1218 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:13.759685 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6da6f179-a313-452b-a79d-1aa22fe40e30 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:13.766831 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6da6f179-a313-452b-a79d-1aa22fe40e30 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:13.778140 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6da6f179-a313-452b-a79d-1aa22fe40e30 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:13.781119 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6da6f179-a313-452b-a79d-1aa22fe40e30 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:13.781813 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6da6f179-a313-452b-a79d-1aa22fe40e30 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:13.782869 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6da6f179-a313-452b-a79d-1aa22fe40e30 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:13.787244 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6da6f179-a313-452b-a79d-1aa22fe40e30 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:13.787863 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6da6f179-a313-452b-a79d-1aa22fe40e30 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:13.829820 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d7862f94-7963-4add-8261-1b9c530fbc80 tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/8c06b938-7008-4367-8861-723717c78131" status: 200 len: 344 microversion: 2.1 time: 0.106510 Sep 07 15:56:13.830588 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 27/56] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Sep 7 15:56:13 2022] GET /compute/v2.1/os-volumes/8c06b938-7008-4367-8861-723717c78131 => generated 344 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:56:13.936879 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6da6f179-a313-452b-a79d-1aa22fe40e30 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:13.946038 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6da6f179-a313-452b-a79d-1aa22fe40e30 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:13.951339 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6da6f179-a313-452b-a79d-1aa22fe40e30 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:13.956367 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6da6f179-a313-452b-a79d-1aa22fe40e30 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1332 microversion: 2.20 time: 0.200894 Sep 07 15:56:13.957871 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 30/57] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:56:13 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1332 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:56:14.614653 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-15579703-d267-41d0-8734-b9960b3df855 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:14.615206 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-15579703-d267-41d0-8734-b9960b3df855 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:14.639006 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-15579703-d267-41d0-8734-b9960b3df855 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:14.639732 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-15579703-d267-41d0-8734-b9960b3df855 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:14.640317 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-15579703-d267-41d0-8734-b9960b3df855 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:14.641228 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-15579703-d267-41d0-8734-b9960b3df855 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:14.641690 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-15579703-d267-41d0-8734-b9960b3df855 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:14.642120 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-15579703-d267-41d0-8734-b9960b3df855 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:14.783275 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cef094db-8082-4705-bcda-78673e3e2b29 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:14.786498 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cef094db-8082-4705-bcda-78673e3e2b29 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:14.806069 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cef094db-8082-4705-bcda-78673e3e2b29 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:14.806867 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cef094db-8082-4705-bcda-78673e3e2b29 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:14.808406 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cef094db-8082-4705-bcda-78673e3e2b29 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:14.809878 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cef094db-8082-4705-bcda-78673e3e2b29 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:14.812902 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cef094db-8082-4705-bcda-78673e3e2b29 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:14.816478 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cef094db-8082-4705-bcda-78673e3e2b29 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:14.974108 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-cef094db-8082-4705-bcda-78673e3e2b29 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:14.980311 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-15579703-d267-41d0-8734-b9960b3df855 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:15.000441 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-15579703-d267-41d0-8734-b9960b3df855 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1315 microversion: 2.1 time: 0.389281 Sep 07 15:56:15.000950 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cef094db-8082-4705-bcda-78673e3e2b29 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1218 microversion: 2.1 time: 0.219830 Sep 07 15:56:15.002085 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 28/58] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:14 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1315 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:15.002427 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 31/59] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:14 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1218 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:56:15.009149 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a1fc3efc-28d2-4d2f-a0fa-91dcb243318f tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] Calling method '.version_select at 0x7ff9a5ffa040>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:15.013024 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0bfd6ca9-5178-4430-8a93-ec37e1d9f3ee tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:15.015947 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0bfd6ca9-5178-4430-8a93-ec37e1d9f3ee tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:15.027871 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0bfd6ca9-5178-4430-8a93-ec37e1d9f3ee tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:15.029228 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0bfd6ca9-5178-4430-8a93-ec37e1d9f3ee tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:15.029978 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0bfd6ca9-5178-4430-8a93-ec37e1d9f3ee tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:15.031748 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0bfd6ca9-5178-4430-8a93-ec37e1d9f3ee tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:15.032501 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0bfd6ca9-5178-4430-8a93-ec37e1d9f3ee tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:15.033137 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0bfd6ca9-5178-4430-8a93-ec37e1d9f3ee tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:15.123803 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-a1fc3efc-28d2-4d2f-a0fa-91dcb243318f tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] HTTP exception thrown: Volume 8c06b938-7008-4367-8861-723717c78131 could not be found. Sep 07 15:56:15.125848 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a1fc3efc-28d2-4d2f-a0fa-91dcb243318f tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] Request method failure captured: Sep 07 15:56:15.125848 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: request: GET /compute/v2.1/os-volumes/8c06b938-7008-4367-8861-723717c78131 HTTP/1.1 Sep 07 15:56:15.125848 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept: application/json Sep 07 15:56:15.125848 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Sep 07 15:56:15.125848 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Connection: close Sep 07 15:56:15.125848 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Length: 0 Sep 07 15:56:15.125848 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Type: application/json Sep 07 15:56:15.125848 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Host: 10.222.0.17 Sep 07 15:56:15.125848 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Sep 07 15:56:15.125848 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Sep 07 15:56:15.125848 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjGL8EFsJT0pN_M_soDnZ7rmT1qNGJE-4qsTMyNiem2UOopSz3mbfOvA4DKKWpFHOTcx_R1uvA6Gktp5OTgONM6PWAWXtYmvilq1KV4_9InZLIWc4lii4GSK9nIsexmpWofVKr8IfVG2IjWFPHh-D8_oxSCnlDUYS3oxUXQxCG4ZzWTpw Sep 07 15:56:15.125848 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Sep 07 15:56:15.125848 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Sep 07 15:56:15.125848 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Sep 07 15:56:15.125848 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Sep 07 15:56:15.125848 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Sep 07 15:56:15.125848 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Sep 07 15:56:15.125848 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Id: d1416faa95b24d76b2189a0cf79e3389 Sep 07 15:56:15.125848 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-530902128 Sep 07 15:56:15.125848 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Role: reader,member Sep 07 15:56:15.125848 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Roles: reader,member Sep 07 15:56:15.126968 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d1416faa95b24d76b2189a0cf79e3389", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d1416faa95b24d76b2189a0cf79e3389"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d1416faa95b24d76b2189a0cf79e3389"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d1416faa95b24d76b2189a0cf79e3389"}]}] Sep 07 15:56:15.126968 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-VolumesSnapshotsTestJSON-530902128 Sep 07 15:56:15.126968 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Id: d1416faa95b24d76b2189a0cf79e3389 Sep 07 15:56:15.126968 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-530902128 Sep 07 15:56:15.126968 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User: tempest-VolumesSnapshotsTestJSON-530902128-project Sep 07 15:56:15.126968 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Sep 07 15:56:15.126968 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Sep 07 15:56:15.126968 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Id: 53642660b6584d5e89f8e3e9c0d3a301 Sep 07 15:56:15.126968 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-VolumesSnapshotsTestJSON-530902128-project Sep 07 15:56:15.126968 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: method: Sep 07 15:56:15.126968 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: exception: Volume 8c06b938-7008-4367-8861-723717c78131 could not be found. Sep 07 15:56:15.126968 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: action_args: {'id': '8c06b938-7008-4367-8861-723717c78131'} Sep 07 15:56:15.126968 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 15:56:15.127817 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:56:15.127817 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 15:56:15.127817 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 15:56:15.127817 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 15:56:15.127817 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 15:56:15.127817 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 15:56:15.127817 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 15:56:15.127817 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 15:56:15.127817 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 15:56:15.127817 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 15:56:15.127817 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 15:56:15.127817 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 15:56:15.127817 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 15:56:15.127817 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 15:56:15.127817 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 15:56:15.127817 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8c06b938-7008-4367-8861-723717c78131 could not be found. (HTTP 404) (Request-ID: req-11ae0543-545b-4921-98fd-5a935e5eb982) Sep 07 15:56:15.127817 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:56:15.127817 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 15:56:15.127817 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:56:15.128902 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:56:15.128902 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 07 15:56:15.128902 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 07 15:56:15.128902 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 15:56:15.128902 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 15:56:15.128902 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 15:56:15.128902 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 15:56:15.128902 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 15:56:15.128902 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 15:56:15.128902 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 15:56:15.128902 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 15:56:15.128902 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 15:56:15.128902 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 15:56:15.128902 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 15:56:15.128902 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 15:56:15.128902 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 15:56:15.128902 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 15:56:15.128902 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 15:56:15.128902 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 15:56:15.129939 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 15:56:15.129939 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 15:56:15.129939 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 15:56:15.129939 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 15:56:15.129939 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8c06b938-7008-4367-8861-723717c78131 could not be found. Sep 07 15:56:15.129939 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:56:15.129939 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 15:56:15.129939 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:56:15.129939 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:56:15.129939 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 15:56:15.129939 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 15:56:15.129939 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 15:56:15.129939 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 15:56:15.129939 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 15:56:15.129939 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 15:56:15.129939 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 15:56:15.129939 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 15:56:15.129939 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 07 15:56:15.129939 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 15:56:15.130855 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8c06b938-7008-4367-8861-723717c78131 could not be found. Sep 07 15:56:15.130855 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:56:15.130855 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 15:56:15.130855 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:56:15.130855 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:56:15.130855 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 15:56:15.130855 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 15:56:15.130855 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 15:56:15.130855 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 15:56:15.130855 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8c06b938-7008-4367-8861-723717c78131 could not be found. Sep 07 15:56:15.130855 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:56:15.130855 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a1fc3efc-28d2-4d2f-a0fa-91dcb243318f tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] Returning 404 to user: Volume 8c06b938-7008-4367-8861-723717c78131 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 15:56:15.130855 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a1fc3efc-28d2-4d2f-a0fa-91dcb243318f tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/8c06b938-7008-4367-8861-723717c78131" status: 404 len: 109 microversion: 2.1 time: 0.121927 Sep 07 15:56:15.130855 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 32/60] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Sep 7 15:56:15 2022] GET /compute/v2.1/os-volumes/8c06b938-7008-4367-8861-723717c78131 => generated 109 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 15:56:15.139683 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-05d619b0-547f-479d-aa3c-133b29b24ff9 tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] Calling method '.version_select at 0x7ff9a5ffa4c0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:15.205218 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-05d619b0-547f-479d-aa3c-133b29b24ff9 tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] HTTP exception thrown: Volume 8c06b938-7008-4367-8861-723717c78131 could not be found. Sep 07 15:56:15.207408 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-05d619b0-547f-479d-aa3c-133b29b24ff9 tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] Request method failure captured: Sep 07 15:56:15.207408 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: request: DELETE /compute/v2.1/os-volumes/8c06b938-7008-4367-8861-723717c78131 HTTP/1.1 Sep 07 15:56:15.207408 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept: application/json Sep 07 15:56:15.207408 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Sep 07 15:56:15.207408 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Connection: close Sep 07 15:56:15.207408 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Length: 0 Sep 07 15:56:15.207408 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Type: application/json Sep 07 15:56:15.207408 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Host: 10.222.0.17 Sep 07 15:56:15.207408 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Sep 07 15:56:15.207408 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Sep 07 15:56:15.207408 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjGL8EFsJT0pN_M_soDnZ7rmT1qNGJE-4qsTMyNiem2UOopSz3mbfOvA4DKKWpFHOTcx_R1uvA6Gktp5OTgONM6PWAWXtYmvilq1KV4_9InZLIWc4lii4GSK9nIsexmpWofVKr8IfVG2IjWFPHh-D8_oxSCnlDUYS3oxUXQxCG4ZzWTpw Sep 07 15:56:15.207408 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Sep 07 15:56:15.207408 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Sep 07 15:56:15.207408 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Sep 07 15:56:15.207408 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Sep 07 15:56:15.207408 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Sep 07 15:56:15.207408 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Sep 07 15:56:15.207408 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Id: d1416faa95b24d76b2189a0cf79e3389 Sep 07 15:56:15.207408 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-530902128 Sep 07 15:56:15.207408 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Role: reader,member Sep 07 15:56:15.207408 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Roles: reader,member Sep 07 15:56:15.208578 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d1416faa95b24d76b2189a0cf79e3389", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d1416faa95b24d76b2189a0cf79e3389"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d1416faa95b24d76b2189a0cf79e3389"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d1416faa95b24d76b2189a0cf79e3389"}]}] Sep 07 15:56:15.208578 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-VolumesSnapshotsTestJSON-530902128 Sep 07 15:56:15.208578 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Id: d1416faa95b24d76b2189a0cf79e3389 Sep 07 15:56:15.208578 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-530902128 Sep 07 15:56:15.208578 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User: tempest-VolumesSnapshotsTestJSON-530902128-project Sep 07 15:56:15.208578 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Sep 07 15:56:15.208578 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Sep 07 15:56:15.208578 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Id: 53642660b6584d5e89f8e3e9c0d3a301 Sep 07 15:56:15.208578 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-VolumesSnapshotsTestJSON-530902128-project Sep 07 15:56:15.208578 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: method: Sep 07 15:56:15.208578 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: exception: Volume 8c06b938-7008-4367-8861-723717c78131 could not be found. Sep 07 15:56:15.208578 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: action_args: {'id': '8c06b938-7008-4367-8861-723717c78131'} Sep 07 15:56:15.208578 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 15:56:15.209276 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:56:15.209276 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 15:56:15.209276 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 15:56:15.209276 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 15:56:15.209276 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 15:56:15.209276 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 15:56:15.209276 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 15:56:15.209276 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 15:56:15.209276 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 15:56:15.209276 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 15:56:15.209276 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 15:56:15.209276 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 15:56:15.209276 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 15:56:15.209276 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 15:56:15.209276 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 15:56:15.209276 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8c06b938-7008-4367-8861-723717c78131 could not be found. (HTTP 404) (Request-ID: req-d278fde3-27d2-4c0f-9b89-854019c7a299) Sep 07 15:56:15.209276 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:56:15.209276 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 15:56:15.209276 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:56:15.210232 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:56:15.210232 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 07 15:56:15.210232 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 07 15:56:15.210232 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 15:56:15.210232 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 15:56:15.210232 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 15:56:15.210232 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 15:56:15.210232 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 15:56:15.210232 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 15:56:15.210232 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 15:56:15.210232 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 15:56:15.210232 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 15:56:15.210232 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 15:56:15.210232 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 15:56:15.210232 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 15:56:15.210232 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 15:56:15.210232 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 15:56:15.210232 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 15:56:15.210232 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 15:56:15.211249 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 15:56:15.211249 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 15:56:15.211249 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 15:56:15.211249 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 15:56:15.211249 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8c06b938-7008-4367-8861-723717c78131 could not be found. Sep 07 15:56:15.211249 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:56:15.211249 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 15:56:15.211249 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:56:15.211249 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:56:15.211249 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 15:56:15.211249 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 15:56:15.211249 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 15:56:15.211249 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 15:56:15.211249 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 15:56:15.211249 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 15:56:15.211249 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 15:56:15.211249 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 15:56:15.211249 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 07 15:56:15.211249 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 15:56:15.212247 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8c06b938-7008-4367-8861-723717c78131 could not be found. Sep 07 15:56:15.212247 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:56:15.212247 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 15:56:15.212247 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:56:15.212247 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:56:15.212247 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 15:56:15.212247 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 15:56:15.212247 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 15:56:15.212247 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 15:56:15.212247 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8c06b938-7008-4367-8861-723717c78131 could not be found. Sep 07 15:56:15.212247 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:56:15.212247 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-05d619b0-547f-479d-aa3c-133b29b24ff9 tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] Returning 404 to user: Volume 8c06b938-7008-4367-8861-723717c78131 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 15:56:15.212247 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-05d619b0-547f-479d-aa3c-133b29b24ff9 tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/8c06b938-7008-4367-8861-723717c78131" status: 404 len: 109 microversion: 2.1 time: 0.073883 Sep 07 15:56:15.212247 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 33/61] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Sep 7 15:56:15 2022] DELETE /compute/v2.1/os-volumes/8c06b938-7008-4367-8861-723717c78131 => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 15:56:15.217978 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9c9f12de-704c-47ed-a4e7-b9152077fec0 tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] Calling method '.version_select at 0x7ff9a5fe9d30>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:15.222686 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-0bfd6ca9-5178-4430-8a93-ec37e1d9f3ee tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:15.232364 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-0bfd6ca9-5178-4430-8a93-ec37e1d9f3ee tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:15.233793 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-0bfd6ca9-5178-4430-8a93-ec37e1d9f3ee tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:15.234893 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0bfd6ca9-5178-4430-8a93-ec37e1d9f3ee tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1340 microversion: 2.20 time: 0.231170 Sep 07 15:56:15.235432 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 29/62] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:56:15 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1340 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:56:15.283705 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-9c9f12de-704c-47ed-a4e7-b9152077fec0 tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] HTTP exception thrown: Volume 8c06b938-7008-4367-8861-723717c78131 could not be found. Sep 07 15:56:15.285794 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9c9f12de-704c-47ed-a4e7-b9152077fec0 tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] Request method failure captured: Sep 07 15:56:15.285794 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: request: GET /compute/v2.1/os-volumes/8c06b938-7008-4367-8861-723717c78131 HTTP/1.1 Sep 07 15:56:15.285794 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept: application/json Sep 07 15:56:15.285794 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Sep 07 15:56:15.285794 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Connection: close Sep 07 15:56:15.285794 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Length: 0 Sep 07 15:56:15.285794 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Type: application/json Sep 07 15:56:15.285794 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Host: 10.222.0.17 Sep 07 15:56:15.285794 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Sep 07 15:56:15.285794 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Sep 07 15:56:15.285794 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjGL8EFsJT0pN_M_soDnZ7rmT1qNGJE-4qsTMyNiem2UOopSz3mbfOvA4DKKWpFHOTcx_R1uvA6Gktp5OTgONM6PWAWXtYmvilq1KV4_9InZLIWc4lii4GSK9nIsexmpWofVKr8IfVG2IjWFPHh-D8_oxSCnlDUYS3oxUXQxCG4ZzWTpw Sep 07 15:56:15.285794 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Sep 07 15:56:15.285794 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Sep 07 15:56:15.285794 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Sep 07 15:56:15.285794 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Sep 07 15:56:15.285794 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Sep 07 15:56:15.285794 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Sep 07 15:56:15.285794 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Id: d1416faa95b24d76b2189a0cf79e3389 Sep 07 15:56:15.285794 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-530902128 Sep 07 15:56:15.285794 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Role: reader,member Sep 07 15:56:15.285794 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Roles: reader,member Sep 07 15:56:15.286976 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d1416faa95b24d76b2189a0cf79e3389", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d1416faa95b24d76b2189a0cf79e3389"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d1416faa95b24d76b2189a0cf79e3389"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d1416faa95b24d76b2189a0cf79e3389"}]}] Sep 07 15:56:15.286976 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-VolumesSnapshotsTestJSON-530902128 Sep 07 15:56:15.286976 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Id: d1416faa95b24d76b2189a0cf79e3389 Sep 07 15:56:15.286976 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-530902128 Sep 07 15:56:15.286976 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User: tempest-VolumesSnapshotsTestJSON-530902128-project Sep 07 15:56:15.286976 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Sep 07 15:56:15.286976 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Sep 07 15:56:15.286976 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Id: 53642660b6584d5e89f8e3e9c0d3a301 Sep 07 15:56:15.286976 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-VolumesSnapshotsTestJSON-530902128-project Sep 07 15:56:15.286976 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: method: Sep 07 15:56:15.286976 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: exception: Volume 8c06b938-7008-4367-8861-723717c78131 could not be found. Sep 07 15:56:15.286976 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: action_args: {'id': '8c06b938-7008-4367-8861-723717c78131'} Sep 07 15:56:15.286976 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 15:56:15.287730 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:56:15.287730 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 15:56:15.287730 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 15:56:15.287730 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 15:56:15.287730 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 15:56:15.287730 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 15:56:15.287730 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 15:56:15.287730 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 15:56:15.287730 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 15:56:15.287730 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 15:56:15.287730 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 15:56:15.287730 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 15:56:15.287730 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 15:56:15.287730 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 15:56:15.287730 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 15:56:15.287730 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8c06b938-7008-4367-8861-723717c78131 could not be found. (HTTP 404) (Request-ID: req-41ead467-729f-467d-83f2-9a0fa2794ad3) Sep 07 15:56:15.287730 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:56:15.287730 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 15:56:15.287730 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:56:15.288720 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:56:15.288720 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 07 15:56:15.288720 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 07 15:56:15.288720 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 15:56:15.288720 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 15:56:15.288720 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 15:56:15.288720 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 15:56:15.288720 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 15:56:15.288720 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 15:56:15.288720 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 15:56:15.288720 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 15:56:15.288720 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 15:56:15.288720 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 15:56:15.288720 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 15:56:15.288720 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 15:56:15.288720 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 15:56:15.288720 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 15:56:15.288720 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 15:56:15.288720 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 15:56:15.289675 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 15:56:15.289675 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 15:56:15.289675 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 15:56:15.289675 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 15:56:15.289675 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8c06b938-7008-4367-8861-723717c78131 could not be found. Sep 07 15:56:15.289675 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:56:15.289675 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 15:56:15.289675 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:56:15.289675 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:56:15.289675 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 15:56:15.289675 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 15:56:15.289675 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 15:56:15.289675 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 15:56:15.289675 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 15:56:15.289675 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 15:56:15.289675 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 15:56:15.289675 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 15:56:15.289675 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 07 15:56:15.289675 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 15:56:15.290584 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8c06b938-7008-4367-8861-723717c78131 could not be found. Sep 07 15:56:15.290584 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:56:15.290584 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 15:56:15.290584 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:56:15.290584 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:56:15.290584 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 15:56:15.290584 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 15:56:15.290584 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 15:56:15.290584 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 15:56:15.290584 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8c06b938-7008-4367-8861-723717c78131 could not be found. Sep 07 15:56:15.290584 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:56:15.290584 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9c9f12de-704c-47ed-a4e7-b9152077fec0 tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] Returning 404 to user: Volume 8c06b938-7008-4367-8861-723717c78131 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 15:56:15.290584 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9c9f12de-704c-47ed-a4e7-b9152077fec0 tempest-VolumesSnapshotsTestJSON-530902128 tempest-VolumesSnapshotsTestJSON-530902128-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/8c06b938-7008-4367-8861-723717c78131" status: 404 len: 109 microversion: 2.1 time: 0.073484 Sep 07 15:56:15.296943 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 34/63] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Sep 7 15:56:15 2022] GET /compute/v2.1/os-volumes/8c06b938-7008-4367-8861-723717c78131 => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 15:56:16.040754 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4a5a930d-0b18-440d-b4dc-4730c033a048 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:16.041322 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-afaeb546-d2a7-478a-a6f8-1d7526035b7c tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:16.041989 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-afaeb546-d2a7-478a-a6f8-1d7526035b7c tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:16.048302 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4a5a930d-0b18-440d-b4dc-4730c033a048 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:16.070863 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a5a930d-0b18-440d-b4dc-4730c033a048 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:16.083137 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a5a930d-0b18-440d-b4dc-4730c033a048 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:16.084052 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a5a930d-0b18-440d-b4dc-4730c033a048 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:16.084825 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a5a930d-0b18-440d-b4dc-4730c033a048 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:16.085300 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a5a930d-0b18-440d-b4dc-4730c033a048 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:16.085860 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-afaeb546-d2a7-478a-a6f8-1d7526035b7c tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:16.086785 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-afaeb546-d2a7-478a-a6f8-1d7526035b7c tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:16.088765 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-afaeb546-d2a7-478a-a6f8-1d7526035b7c tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:16.089684 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-afaeb546-d2a7-478a-a6f8-1d7526035b7c tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:16.092667 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-afaeb546-d2a7-478a-a6f8-1d7526035b7c tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:16.093128 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-afaeb546-d2a7-478a-a6f8-1d7526035b7c tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:16.093512 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a5a930d-0b18-440d-b4dc-4730c033a048 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:16.517986 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-4a5a930d-0b18-440d-b4dc-4730c033a048 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:16.539836 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4a5a930d-0b18-440d-b4dc-4730c033a048 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1274 microversion: 2.1 time: 0.504283 Sep 07 15:56:16.539836 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 30/64] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:16 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1274 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:16.539836 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9e8d7aa0-efca-48fb-8f7d-90d69cdddb73 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:16.540400 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9e8d7aa0-efca-48fb-8f7d-90d69cdddb73 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:16.569119 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9e8d7aa0-efca-48fb-8f7d-90d69cdddb73 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:16.569768 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9e8d7aa0-efca-48fb-8f7d-90d69cdddb73 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:16.570184 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9e8d7aa0-efca-48fb-8f7d-90d69cdddb73 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:16.571112 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9e8d7aa0-efca-48fb-8f7d-90d69cdddb73 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:16.571781 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9e8d7aa0-efca-48fb-8f7d-90d69cdddb73 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:16.572416 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9e8d7aa0-efca-48fb-8f7d-90d69cdddb73 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:16.702869 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-9e8d7aa0-efca-48fb-8f7d-90d69cdddb73 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:16.714949 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-9e8d7aa0-efca-48fb-8f7d-90d69cdddb73 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:16.720333 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-9e8d7aa0-efca-48fb-8f7d-90d69cdddb73 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:16.724188 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9e8d7aa0-efca-48fb-8f7d-90d69cdddb73 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1338 microversion: 2.20 time: 0.190639 Sep 07 15:56:16.729488 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 31/65] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:56:16 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1338 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:56:17.249837 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-afaeb546-d2a7-478a-a6f8-1d7526035b7c tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:17.265141 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-afaeb546-d2a7-478a-a6f8-1d7526035b7c tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1315 microversion: 2.1 time: 1.240795 Sep 07 15:56:17.266173 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 35/66] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:16 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1315 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:17.569211 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-91aa8b5c-c963-430c-aef5-3cbfd99eff97 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:17.570551 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-91aa8b5c-c963-430c-aef5-3cbfd99eff97 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:17.580280 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-91aa8b5c-c963-430c-aef5-3cbfd99eff97 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:17.584474 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-91aa8b5c-c963-430c-aef5-3cbfd99eff97 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:17.588337 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-91aa8b5c-c963-430c-aef5-3cbfd99eff97 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:17.589324 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-91aa8b5c-c963-430c-aef5-3cbfd99eff97 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:17.590018 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-91aa8b5c-c963-430c-aef5-3cbfd99eff97 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:17.590978 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-91aa8b5c-c963-430c-aef5-3cbfd99eff97 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:17.766101 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-db806784-75c3-4441-a88f-9edcbe890606 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:17.767514 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-db806784-75c3-4441-a88f-9edcbe890606 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:17.786038 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db806784-75c3-4441-a88f-9edcbe890606 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:17.818176 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db806784-75c3-4441-a88f-9edcbe890606 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:17.819063 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db806784-75c3-4441-a88f-9edcbe890606 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:17.825676 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db806784-75c3-4441-a88f-9edcbe890606 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:17.826719 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db806784-75c3-4441-a88f-9edcbe890606 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:17.829235 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db806784-75c3-4441-a88f-9edcbe890606 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:18.057663 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-91aa8b5c-c963-430c-aef5-3cbfd99eff97 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:18.070580 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-91aa8b5c-c963-430c-aef5-3cbfd99eff97 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1282 microversion: 2.1 time: 0.506701 Sep 07 15:56:18.076207 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 32/67] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:17 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1282 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:18.134792 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-db806784-75c3-4441-a88f-9edcbe890606 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:18.158880 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-db806784-75c3-4441-a88f-9edcbe890606 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:18.183779 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-db806784-75c3-4441-a88f-9edcbe890606 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:18.188477 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-db806784-75c3-4441-a88f-9edcbe890606 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1338 microversion: 2.20 time: 0.427421 Sep 07 15:56:18.191291 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 36/68] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:56:17 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1338 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:56:18.301026 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fda66122-8780-4614-a8f9-770060930d32 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:18.302027 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fda66122-8780-4614-a8f9-770060930d32 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:18.316469 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fda66122-8780-4614-a8f9-770060930d32 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:18.317192 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fda66122-8780-4614-a8f9-770060930d32 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:18.317841 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fda66122-8780-4614-a8f9-770060930d32 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:18.319486 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fda66122-8780-4614-a8f9-770060930d32 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:18.320400 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fda66122-8780-4614-a8f9-770060930d32 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:18.320958 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fda66122-8780-4614-a8f9-770060930d32 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:19.100423 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f0fcc448-ed01-4934-b02e-2971ed7735d2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:19.101015 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f0fcc448-ed01-4934-b02e-2971ed7735d2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:19.104053 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=4 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:19.123291 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0fcc448-ed01-4934-b02e-2971ed7735d2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:19.124279 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0fcc448-ed01-4934-b02e-2971ed7735d2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:19.127389 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0fcc448-ed01-4934-b02e-2971ed7735d2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:19.131012 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0fcc448-ed01-4934-b02e-2971ed7735d2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:19.132201 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0fcc448-ed01-4934-b02e-2971ed7735d2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:19.133289 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0fcc448-ed01-4934-b02e-2971ed7735d2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:19.210376 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-fda66122-8780-4614-a8f9-770060930d32 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:19.224085 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fda66122-8780-4614-a8f9-770060930d32 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1315 microversion: 2.1 time: 0.934748 Sep 07 15:56:19.225342 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 33/69] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:18 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1315 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:19.231406 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-11c20d66-44d7-49d5-8ecd-ca9bf3383475 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:19.232265 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-11c20d66-44d7-49d5-8ecd-ca9bf3383475 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:19.241096 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-11c20d66-44d7-49d5-8ecd-ca9bf3383475 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:19.241830 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-11c20d66-44d7-49d5-8ecd-ca9bf3383475 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:19.242763 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-11c20d66-44d7-49d5-8ecd-ca9bf3383475 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:19.244091 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-11c20d66-44d7-49d5-8ecd-ca9bf3383475 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:19.244899 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-11c20d66-44d7-49d5-8ecd-ca9bf3383475 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:19.245593 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-11c20d66-44d7-49d5-8ecd-ca9bf3383475 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:19.282411 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f0fcc448-ed01-4934-b02e-2971ed7735d2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:19.303594 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f0fcc448-ed01-4934-b02e-2971ed7735d2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1280 microversion: 2.1 time: 0.207282 Sep 07 15:56:19.310153 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 37/70] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:19 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1280 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:56:19.572968 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-11c20d66-44d7-49d5-8ecd-ca9bf3383475 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:19.588797 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-11c20d66-44d7-49d5-8ecd-ca9bf3383475 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:19.595214 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-11c20d66-44d7-49d5-8ecd-ca9bf3383475 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:19.598240 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-11c20d66-44d7-49d5-8ecd-ca9bf3383475 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1338 microversion: 2.20 time: 0.371560 Sep 07 15:56:19.602481 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 34/71] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:56:19 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1338 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:56:19.803993 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-9f03b3f7-2be6-4864-bd27-f88462038286 req-e6e0c1b3-5037-4f01-af7c-3a516a3e3971 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "881d1d65-f44f-40d2-9e0e-01f29e5bd88a", "tag": "ae90bf0e-889b-437f-8ebd-f3878af5201c"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:56:19.836555 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9f03b3f7-2be6-4864-bd27-f88462038286 req-e6e0c1b3-5037-4f01-af7c-3a516a3e3971 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:19.839258 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9f03b3f7-2be6-4864-bd27-f88462038286 req-e6e0c1b3-5037-4f01-af7c-3a516a3e3971 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:19.840561 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9f03b3f7-2be6-4864-bd27-f88462038286 req-e6e0c1b3-5037-4f01-af7c-3a516a3e3971 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:19.923235 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-9f03b3f7-2be6-4864-bd27-f88462038286 req-e6e0c1b3-5037-4f01-af7c-3a516a3e3971 service nova] Creating event network-changed:ae90bf0e-889b-437f-8ebd-f3878af5201c for instance 881d1d65-f44f-40d2-9e0e-01f29e5bd88a on hv-cinder-85331 Sep 07 15:56:19.932032 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9f03b3f7-2be6-4864-bd27-f88462038286 req-e6e0c1b3-5037-4f01-af7c-3a516a3e3971 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120640) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 07 15:56:19.932440 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9f03b3f7-2be6-4864-bd27-f88462038286 req-e6e0c1b3-5037-4f01-af7c-3a516a3e3971 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120640) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 07 15:56:19.933773 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc681b3b-9ed6-43ca-8d52-4f4b739038c9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:19.936198 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc681b3b-9ed6-43ca-8d52-4f4b739038c9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:19.939690 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc681b3b-9ed6-43ca-8d52-4f4b739038c9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:19.941249 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc681b3b-9ed6-43ca-8d52-4f4b739038c9 None None] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:19.942700 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc681b3b-9ed6-43ca-8d52-4f4b739038c9 None None] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:19.944046 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc681b3b-9ed6-43ca-8d52-4f4b739038c9 None None] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:19.968853 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.compute.rpcapi [None req-fc681b3b-9ed6-43ca-8d52-4f4b739038c9 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 07 15:56:19.973146 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc681b3b-9ed6-43ca-8d52-4f4b739038c9 None None] Releasing lock "compute-rpcapi-router" {{(pid=120640) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 07 15:56:20.013524 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fc681b3b-9ed6-43ca-8d52-4f4b739038c9 None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.557500 Sep 07 15:56:20.016697 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 38/72] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 15:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 15:56:20.253026 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=4 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:20.257616 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-39895205-732e-4078-80ac-1bd8ddc91b5b tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:20.258365 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-39895205-732e-4078-80ac-1bd8ddc91b5b tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:20.273728 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=20 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:20.280336 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-39895205-732e-4078-80ac-1bd8ddc91b5b tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:20.281392 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-39895205-732e-4078-80ac-1bd8ddc91b5b tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:20.283790 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-39895205-732e-4078-80ac-1bd8ddc91b5b tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:20.285721 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-39895205-732e-4078-80ac-1bd8ddc91b5b tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:20.290701 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-39895205-732e-4078-80ac-1bd8ddc91b5b tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:20.291447 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-39895205-732e-4078-80ac-1bd8ddc91b5b tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:20.441649 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=18 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:20.548741 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9bf7b690-b5f8-4156-a832-7d1238bfb432 tempest-VolumesGetTestJSON-1556485462 tempest-VolumesGetTestJSON-1556485462-project] Action: 'create', calling method: .version_select at 0x7ff9a5f68160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1677914970", "metadata": {"Type": "work"}}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:56:21.234801 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-39895205-732e-4078-80ac-1bd8ddc91b5b tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:21.247733 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-39895205-732e-4078-80ac-1bd8ddc91b5b tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1315 microversion: 2.1 time: 0.999845 Sep 07 15:56:21.267469 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 39/73] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:20 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1315 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:56:21.272931 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-664c51da-9ce8-4dd6-a553-29c763e1515e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:21.273547 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-664c51da-9ce8-4dd6-a553-29c763e1515e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:21.291667 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-664c51da-9ce8-4dd6-a553-29c763e1515e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:21.293688 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-664c51da-9ce8-4dd6-a553-29c763e1515e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:21.294141 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-664c51da-9ce8-4dd6-a553-29c763e1515e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:21.294864 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-664c51da-9ce8-4dd6-a553-29c763e1515e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:21.295322 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-664c51da-9ce8-4dd6-a553-29c763e1515e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:21.300567 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-664c51da-9ce8-4dd6-a553-29c763e1515e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:21.320456 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9bf7b690-b5f8-4156-a832-7d1238bfb432 tempest-VolumesGetTestJSON-1556485462 tempest-VolumesGetTestJSON-1556485462-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.095735 Sep 07 15:56:21.321791 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 35/74] 10.222.0.17 () {60 vars in 1156 bytes} [Wed Sep 7 15:56:20 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1098 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 07 15:56:21.329117 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9b927bb4-6f16-4ae5-8941-e4fc9e2de520 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:21.331568 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9b927bb4-6f16-4ae5-8941-e4fc9e2de520 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:21.355494 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9b927bb4-6f16-4ae5-8941-e4fc9e2de520 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:21.356626 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9b927bb4-6f16-4ae5-8941-e4fc9e2de520 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:21.357062 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9b927bb4-6f16-4ae5-8941-e4fc9e2de520 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:21.357768 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9b927bb4-6f16-4ae5-8941-e4fc9e2de520 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:21.358222 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9b927bb4-6f16-4ae5-8941-e4fc9e2de520 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:21.358642 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9b927bb4-6f16-4ae5-8941-e4fc9e2de520 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:21.644557 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-9b927bb4-6f16-4ae5-8941-e4fc9e2de520 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:21.686122 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-9b927bb4-6f16-4ae5-8941-e4fc9e2de520 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:21.689972 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-9b927bb4-6f16-4ae5-8941-e4fc9e2de520 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:21.703693 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9b927bb4-6f16-4ae5-8941-e4fc9e2de520 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1338 microversion: 2.20 time: 0.378431 Sep 07 15:56:21.706754 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 36/75] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:56:21 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1338 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:56:21.924118 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-664c51da-9ce8-4dd6-a553-29c763e1515e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:21.946558 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-664c51da-9ce8-4dd6-a553-29c763e1515e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1322 microversion: 2.1 time: 0.669631 Sep 07 15:56:21.950108 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 40/76] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:21 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1322 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:21.963814 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-05a1b27d-d6b1-4e90-acb7-8eaf8f6a2c49 tempest-VolumesGetTestJSON-1556485462 tempest-VolumesGetTestJSON-1556485462-project] Calling method '.version_select at 0x7ff9a5ffa0d0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:22.205132 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-05a1b27d-d6b1-4e90-acb7-8eaf8f6a2c49 tempest-VolumesGetTestJSON-1556485462 tempest-VolumesGetTestJSON-1556485462-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/f3f32fad-0004-4e3e-a278-56f6caa14274" status: 200 len: 353 microversion: 2.1 time: 0.253654 Sep 07 15:56:22.206283 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 41/77] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Sep 7 15:56:21 2022] GET /compute/v2.1/os-volumes/f3f32fad-0004-4e3e-a278-56f6caa14274 => generated 353 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:56:22.278585 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-495d84d7-f84e-42a1-8112-ca94b5645460 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:22.280178 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-495d84d7-f84e-42a1-8112-ca94b5645460 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:22.298481 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-495d84d7-f84e-42a1-8112-ca94b5645460 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:22.300422 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-495d84d7-f84e-42a1-8112-ca94b5645460 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:22.306138 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-495d84d7-f84e-42a1-8112-ca94b5645460 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:22.314688 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-495d84d7-f84e-42a1-8112-ca94b5645460 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:22.317790 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-495d84d7-f84e-42a1-8112-ca94b5645460 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:22.322426 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-495d84d7-f84e-42a1-8112-ca94b5645460 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:22.538792 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-6db0bd08-a8d6-45a2-859a-5abdc9351ea9 req-2342ecab-a528-4731-8c3d-efac177eecb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f39427e6-62a5-4a4e-96e8-644f03653722", "tag": "c1b41643-a122-48be-8241-42826288f60e"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:56:22.571509 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-6db0bd08-a8d6-45a2-859a-5abdc9351ea9 req-2342ecab-a528-4731-8c3d-efac177eecb4 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:22.572522 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-6db0bd08-a8d6-45a2-859a-5abdc9351ea9 req-2342ecab-a528-4731-8c3d-efac177eecb4 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:22.573286 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-6db0bd08-a8d6-45a2-859a-5abdc9351ea9 req-2342ecab-a528-4731-8c3d-efac177eecb4 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:22.636421 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-6db0bd08-a8d6-45a2-859a-5abdc9351ea9 req-2342ecab-a528-4731-8c3d-efac177eecb4 service nova] Creating event network-changed:c1b41643-a122-48be-8241-42826288f60e for instance f39427e6-62a5-4a4e-96e8-644f03653722 on hv-cinder-85331 Sep 07 15:56:22.638862 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-6db0bd08-a8d6-45a2-859a-5abdc9351ea9 req-2342ecab-a528-4731-8c3d-efac177eecb4 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120641) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 07 15:56:22.639521 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-6db0bd08-a8d6-45a2-859a-5abdc9351ea9 req-2342ecab-a528-4731-8c3d-efac177eecb4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120641) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 07 15:56:22.641364 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fedc00a7-d1c2-4cb0-99db-fb5275beb36e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:22.642146 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fedc00a7-d1c2-4cb0-99db-fb5275beb36e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:22.642744 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fedc00a7-d1c2-4cb0-99db-fb5275beb36e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:22.644022 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fedc00a7-d1c2-4cb0-99db-fb5275beb36e None None] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:22.644847 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fedc00a7-d1c2-4cb0-99db-fb5275beb36e None None] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:22.645481 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fedc00a7-d1c2-4cb0-99db-fb5275beb36e None None] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:22.657583 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.compute.rpcapi [None req-fedc00a7-d1c2-4cb0-99db-fb5275beb36e None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 07 15:56:22.658915 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fedc00a7-d1c2-4cb0-99db-fb5275beb36e None None] Releasing lock "compute-rpcapi-router" {{(pid=120641) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 07 15:56:22.681895 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fedc00a7-d1c2-4cb0-99db-fb5275beb36e None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.973547 Sep 07 15:56:22.683655 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 37/78] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 15:56:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:56:22.734125 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3c8220d9-7669-46e3-a81f-6b1843cf9b90 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:22.735368 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3c8220d9-7669-46e3-a81f-6b1843cf9b90 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:22.757836 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c8220d9-7669-46e3-a81f-6b1843cf9b90 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:22.759920 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c8220d9-7669-46e3-a81f-6b1843cf9b90 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:22.761143 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c8220d9-7669-46e3-a81f-6b1843cf9b90 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:22.763089 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c8220d9-7669-46e3-a81f-6b1843cf9b90 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:22.765164 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c8220d9-7669-46e3-a81f-6b1843cf9b90 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:22.767926 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c8220d9-7669-46e3-a81f-6b1843cf9b90 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:23.038903 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-495d84d7-f84e-42a1-8112-ca94b5645460 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:23.053061 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-495d84d7-f84e-42a1-8112-ca94b5645460 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1315 microversion: 2.1 time: 0.781166 Sep 07 15:56:23.055190 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 42/79] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:22 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1315 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:56:23.084414 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f43a3db1-a016-47d0-ba25-8ba5cb3a4a3e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:23.085059 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f43a3db1-a016-47d0-ba25-8ba5cb3a4a3e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:23.105201 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f43a3db1-a016-47d0-ba25-8ba5cb3a4a3e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:23.105814 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f43a3db1-a016-47d0-ba25-8ba5cb3a4a3e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:23.106322 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f43a3db1-a016-47d0-ba25-8ba5cb3a4a3e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:23.107502 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f43a3db1-a016-47d0-ba25-8ba5cb3a4a3e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:23.112519 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f43a3db1-a016-47d0-ba25-8ba5cb3a4a3e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:23.114841 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f43a3db1-a016-47d0-ba25-8ba5cb3a4a3e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:23.124698 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:23.711214 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f43a3db1-a016-47d0-ba25-8ba5cb3a4a3e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:23.728169 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f43a3db1-a016-47d0-ba25-8ba5cb3a4a3e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1322 microversion: 2.1 time: 0.663606 Sep 07 15:56:23.740368 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 43/80] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:23 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1322 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:23.750528 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4e586348-5334-4b29-ad75-f473edca2ad9 tempest-VolumesGetTestJSON-1556485462 tempest-VolumesGetTestJSON-1556485462-project] Calling method '.version_select at 0x7ff9a5f6dd30>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:23.783929 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-3c8220d9-7669-46e3-a81f-6b1843cf9b90 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:23.803404 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-3c8220d9-7669-46e3-a81f-6b1843cf9b90 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:23.804934 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-3c8220d9-7669-46e3-a81f-6b1843cf9b90 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:23.806422 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3c8220d9-7669-46e3-a81f-6b1843cf9b90 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1406 microversion: 2.20 time: 1.077907 Sep 07 15:56:23.810164 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 38/81] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:56:22 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1406 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 15:56:23.896399 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4e586348-5334-4b29-ad75-f473edca2ad9 tempest-VolumesGetTestJSON-1556485462 tempest-VolumesGetTestJSON-1556485462-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/f3f32fad-0004-4e3e-a278-56f6caa14274" status: 200 len: 354 microversion: 2.1 time: 0.149858 Sep 07 15:56:23.912889 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 44/82] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Sep 7 15:56:23 2022] GET /compute/v2.1/os-volumes/f3f32fad-0004-4e3e-a278-56f6caa14274 => generated 354 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:56:23.919192 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bc96478f-54a2-42ae-9512-3ad1cf577543 tempest-VolumesGetTestJSON-1556485462 tempest-VolumesGetTestJSON-1556485462-project] Calling method '.version_select at 0x7ff9a5fcd310>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:24.078613 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4b4f7964-b89b-4626-8da5-0876a6646812 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:24.079511 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4b4f7964-b89b-4626-8da5-0876a6646812 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:24.092659 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b4f7964-b89b-4626-8da5-0876a6646812 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:24.093338 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b4f7964-b89b-4626-8da5-0876a6646812 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:24.093848 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b4f7964-b89b-4626-8da5-0876a6646812 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:24.094557 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b4f7964-b89b-4626-8da5-0876a6646812 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:24.095158 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b4f7964-b89b-4626-8da5-0876a6646812 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:24.096224 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b4f7964-b89b-4626-8da5-0876a6646812 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:24.108483 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bc96478f-54a2-42ae-9512-3ad1cf577543 tempest-VolumesGetTestJSON-1556485462 tempest-VolumesGetTestJSON-1556485462-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/f3f32fad-0004-4e3e-a278-56f6caa14274" status: 200 len: 354 microversion: 2.1 time: 0.195185 Sep 07 15:56:24.109106 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 39/83] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Sep 7 15:56:23 2022] GET /compute/v2.1/os-volumes/f3f32fad-0004-4e3e-a278-56f6caa14274 => generated 354 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:56:24.132409 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1099f7e4-b2e3-4ece-a59e-7ed6e4df99d8 tempest-VolumesGetTestJSON-1556485462 tempest-VolumesGetTestJSON-1556485462-project] Calling method '.version_select at 0x7ff9a5f66550>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:24.263909 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1099f7e4-b2e3-4ece-a59e-7ed6e4df99d8 tempest-VolumesGetTestJSON-1556485462 tempest-VolumesGetTestJSON-1556485462-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/f3f32fad-0004-4e3e-a278-56f6caa14274" status: 202 len: 0 microversion: 2.1 time: 0.136094 Sep 07 15:56:24.274464 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 40/84] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Sep 7 15:56:24 2022] DELETE /compute/v2.1/os-volumes/f3f32fad-0004-4e3e-a278-56f6caa14274 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 15:56:24.274464 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-106cc27a-2df2-4643-a930-033a724a7a0c req-3269a735-7a5b-4340-aa86-96f8e28502a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "331c4dfb-7ee1-4585-bed9-2e65fa1f062a", "tag": "dcda231d-d2f5-41dc-b0c3-658f97c33345"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:56:24.287391 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-106cc27a-2df2-4643-a930-033a724a7a0c req-3269a735-7a5b-4340-aa86-96f8e28502a7 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:24.287965 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-106cc27a-2df2-4643-a930-033a724a7a0c req-3269a735-7a5b-4340-aa86-96f8e28502a7 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:24.288455 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-106cc27a-2df2-4643-a930-033a724a7a0c req-3269a735-7a5b-4340-aa86-96f8e28502a7 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:24.305601 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-106cc27a-2df2-4643-a930-033a724a7a0c req-3269a735-7a5b-4340-aa86-96f8e28502a7 service nova] Creating event network-changed:dcda231d-d2f5-41dc-b0c3-658f97c33345 for instance 331c4dfb-7ee1-4585-bed9-2e65fa1f062a on hv-cinder-85331 Sep 07 15:56:24.316739 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-106cc27a-2df2-4643-a930-033a724a7a0c req-3269a735-7a5b-4340-aa86-96f8e28502a7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048736 Sep 07 15:56:24.318077 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 41/85] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 15:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:56:24.328590 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-395218ce-8265-4677-8e3a-4a676f342a16 tempest-VolumesGetTestJSON-1556485462 tempest-VolumesGetTestJSON-1556485462-project] Calling method '.version_select at 0x7ff9a5f66700>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:24.392515 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-395218ce-8265-4677-8e3a-4a676f342a16 tempest-VolumesGetTestJSON-1556485462 tempest-VolumesGetTestJSON-1556485462-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/f3f32fad-0004-4e3e-a278-56f6caa14274" status: 200 len: 353 microversion: 2.1 time: 0.072547 Sep 07 15:56:24.394246 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 42/86] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Sep 7 15:56:24 2022] GET /compute/v2.1/os-volumes/f3f32fad-0004-4e3e-a278-56f6caa14274 => generated 353 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:56:24.627340 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-4b4f7964-b89b-4626-8da5-0876a6646812 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:24.646271 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4b4f7964-b89b-4626-8da5-0876a6646812 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1315 microversion: 2.1 time: 0.567483 Sep 07 15:56:24.651054 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 45/87] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:24 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1315 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:24.726985 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-31289a9f-3148-490c-b85d-534aced79982 req-34453612-88fe-4e1a-9dc1-c3b4a6fdee08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "546eacb2-a6cd-44c7-8abf-97798497d947", "tag": "aa591f91-fdf7-4476-bfea-32a7fbad414b"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:56:24.762421 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-67edb950-fc63-4fba-b12e-83ae8efcf071 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:24.764507 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-67edb950-fc63-4fba-b12e-83ae8efcf071 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:24.773168 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-31289a9f-3148-490c-b85d-534aced79982 req-34453612-88fe-4e1a-9dc1-c3b4a6fdee08 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:24.777384 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-31289a9f-3148-490c-b85d-534aced79982 req-34453612-88fe-4e1a-9dc1-c3b4a6fdee08 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:24.778425 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-31289a9f-3148-490c-b85d-534aced79982 req-34453612-88fe-4e1a-9dc1-c3b4a6fdee08 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:24.786680 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67edb950-fc63-4fba-b12e-83ae8efcf071 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:24.788468 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67edb950-fc63-4fba-b12e-83ae8efcf071 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:24.788816 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67edb950-fc63-4fba-b12e-83ae8efcf071 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:24.789701 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67edb950-fc63-4fba-b12e-83ae8efcf071 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:24.790507 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67edb950-fc63-4fba-b12e-83ae8efcf071 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:24.791411 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67edb950-fc63-4fba-b12e-83ae8efcf071 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:24.814066 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-31289a9f-3148-490c-b85d-534aced79982 req-34453612-88fe-4e1a-9dc1-c3b4a6fdee08 service nova] Creating event network-changed:aa591f91-fdf7-4476-bfea-32a7fbad414b for instance 546eacb2-a6cd-44c7-8abf-97798497d947 on hv-cinder-85331 Sep 07 15:56:24.836166 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-31289a9f-3148-490c-b85d-534aced79982 req-34453612-88fe-4e1a-9dc1-c3b4a6fdee08 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116461 Sep 07 15:56:24.837798 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 43/88] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 15:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:56:24.847225 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6558a756-0235-43d1-83a3-e90994998c40 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:24.848352 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6558a756-0235-43d1-83a3-e90994998c40 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:24.855721 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6558a756-0235-43d1-83a3-e90994998c40 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:24.856375 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6558a756-0235-43d1-83a3-e90994998c40 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:24.856954 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6558a756-0235-43d1-83a3-e90994998c40 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:24.857862 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6558a756-0235-43d1-83a3-e90994998c40 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:24.858496 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6558a756-0235-43d1-83a3-e90994998c40 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:24.859121 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6558a756-0235-43d1-83a3-e90994998c40 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:24.983308 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-67edb950-fc63-4fba-b12e-83ae8efcf071 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:24.995498 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-67edb950-fc63-4fba-b12e-83ae8efcf071 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1322 microversion: 2.1 time: 0.244485 Sep 07 15:56:24.998143 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 46/89] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:24 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1322 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:25.410068 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-432621de-6b0d-4080-83d5-73e874a2064d tempest-VolumesGetTestJSON-1556485462 tempest-VolumesGetTestJSON-1556485462-project] Calling method '.version_select at 0x7ff9a5f77430>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:25.531811 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-432621de-6b0d-4080-83d5-73e874a2064d tempest-VolumesGetTestJSON-1556485462 tempest-VolumesGetTestJSON-1556485462-project] HTTP exception thrown: Volume f3f32fad-0004-4e3e-a278-56f6caa14274 could not be found. Sep 07 15:56:25.534866 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-432621de-6b0d-4080-83d5-73e874a2064d tempest-VolumesGetTestJSON-1556485462 tempest-VolumesGetTestJSON-1556485462-project] Request method failure captured: Sep 07 15:56:25.534866 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: request: GET /compute/v2.1/os-volumes/f3f32fad-0004-4e3e-a278-56f6caa14274 HTTP/1.1 Sep 07 15:56:25.534866 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept: application/json Sep 07 15:56:25.534866 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Sep 07 15:56:25.534866 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Connection: close Sep 07 15:56:25.534866 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Length: 0 Sep 07 15:56:25.534866 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Type: application/json Sep 07 15:56:25.534866 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Host: 10.222.0.17 Sep 07 15:56:25.534866 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Sep 07 15:56:25.534866 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Sep 07 15:56:25.534866 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjGL8jlTb-BvbTXsnRB0GMs5AwmRKs4h-08lyl-Bo6CmgrXN3rdybxbDx_hmChYjlb0bqOcpyhhO1IjXhDtYn3jx8IkQWQ5n0QFIt1ur7Dqfubg4MNGXtFNHmw0Jk48qycQd0I7DTRsOGtBuQ8ux6xzieuLoE86zhI37kMC9grKB_Gozg Sep 07 15:56:25.534866 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Sep 07 15:56:25.534866 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Sep 07 15:56:25.534866 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Sep 07 15:56:25.534866 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Sep 07 15:56:25.534866 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Sep 07 15:56:25.534866 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Sep 07 15:56:25.534866 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Id: ec83c74375574d81b4c55fcaa1e601f8 Sep 07 15:56:25.534866 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-VolumesGetTestJSON-1556485462 Sep 07 15:56:25.534866 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Role: reader,member Sep 07 15:56:25.534866 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Roles: reader,member Sep 07 15:56:25.536527 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ec83c74375574d81b4c55fcaa1e601f8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ec83c74375574d81b4c55fcaa1e601f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ec83c74375574d81b4c55fcaa1e601f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ec83c74375574d81b4c55fcaa1e601f8"}]}] Sep 07 15:56:25.536527 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-VolumesGetTestJSON-1556485462 Sep 07 15:56:25.536527 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Id: ec83c74375574d81b4c55fcaa1e601f8 Sep 07 15:56:25.536527 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-VolumesGetTestJSON-1556485462 Sep 07 15:56:25.536527 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User: tempest-VolumesGetTestJSON-1556485462-project Sep 07 15:56:25.536527 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Sep 07 15:56:25.536527 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Sep 07 15:56:25.536527 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Id: c0ebe89791604b76871692c247b5f36b Sep 07 15:56:25.536527 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-VolumesGetTestJSON-1556485462-project Sep 07 15:56:25.536527 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: method: Sep 07 15:56:25.536527 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: exception: Volume f3f32fad-0004-4e3e-a278-56f6caa14274 could not be found. Sep 07 15:56:25.536527 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: action_args: {'id': 'f3f32fad-0004-4e3e-a278-56f6caa14274'} Sep 07 15:56:25.536527 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 15:56:25.537226 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:56:25.537226 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 15:56:25.537226 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 15:56:25.537226 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 15:56:25.537226 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 15:56:25.537226 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 15:56:25.537226 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 15:56:25.537226 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 15:56:25.537226 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 15:56:25.537226 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 15:56:25.537226 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 15:56:25.537226 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 15:56:25.537226 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 15:56:25.537226 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 15:56:25.537226 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 15:56:25.537226 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f3f32fad-0004-4e3e-a278-56f6caa14274 could not be found. (HTTP 404) (Request-ID: req-ccbd5b50-77fd-41a2-bb1a-a31ab96ab138) Sep 07 15:56:25.537226 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:56:25.537226 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 15:56:25.537226 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:56:25.538244 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:56:25.538244 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 07 15:56:25.538244 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 07 15:56:25.538244 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 15:56:25.538244 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 15:56:25.538244 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 15:56:25.538244 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 15:56:25.538244 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 15:56:25.538244 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 15:56:25.538244 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 15:56:25.538244 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 15:56:25.538244 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 15:56:25.538244 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 15:56:25.538244 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 15:56:25.538244 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 15:56:25.538244 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 15:56:25.538244 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 15:56:25.538244 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 15:56:25.538244 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 15:56:25.539251 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 15:56:25.539251 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 15:56:25.539251 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 15:56:25.539251 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 15:56:25.539251 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f3f32fad-0004-4e3e-a278-56f6caa14274 could not be found. Sep 07 15:56:25.539251 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:56:25.539251 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 15:56:25.539251 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:56:25.539251 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:56:25.539251 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 15:56:25.539251 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 15:56:25.539251 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 15:56:25.539251 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 15:56:25.539251 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 15:56:25.539251 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 15:56:25.539251 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 15:56:25.539251 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 15:56:25.539251 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 07 15:56:25.539251 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 15:56:25.540479 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f3f32fad-0004-4e3e-a278-56f6caa14274 could not be found. Sep 07 15:56:25.540479 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:56:25.540479 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 15:56:25.540479 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:56:25.540479 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:56:25.540479 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 15:56:25.540479 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 15:56:25.540479 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 15:56:25.540479 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 15:56:25.540479 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f3f32fad-0004-4e3e-a278-56f6caa14274 could not be found. Sep 07 15:56:25.540479 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:56:25.543446 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-432621de-6b0d-4080-83d5-73e874a2064d tempest-VolumesGetTestJSON-1556485462 tempest-VolumesGetTestJSON-1556485462-project] Returning 404 to user: Volume f3f32fad-0004-4e3e-a278-56f6caa14274 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 15:56:25.544682 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-432621de-6b0d-4080-83d5-73e874a2064d tempest-VolumesGetTestJSON-1556485462 tempest-VolumesGetTestJSON-1556485462-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/f3f32fad-0004-4e3e-a278-56f6caa14274" status: 404 len: 109 microversion: 2.1 time: 0.140281 Sep 07 15:56:25.545414 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 47/90] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Sep 7 15:56:25 2022] GET /compute/v2.1/os-volumes/f3f32fad-0004-4e3e-a278-56f6caa14274 => generated 109 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 15:56:25.569154 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-6558a756-0235-43d1-83a3-e90994998c40 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:25.583244 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-6558a756-0235-43d1-83a3-e90994998c40 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:25.594136 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-6558a756-0235-43d1-83a3-e90994998c40 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:25.600688 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6558a756-0235-43d1-83a3-e90994998c40 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1406 microversion: 2.20 time: 0.760247 Sep 07 15:56:25.607758 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 44/91] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:56:24 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1406 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:56:25.670807 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1e8da6e4-fd54-4f22-a517-7ef00b14280b tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:25.674340 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1e8da6e4-fd54-4f22-a517-7ef00b14280b tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:25.704889 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e8da6e4-fd54-4f22-a517-7ef00b14280b tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:25.708444 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e8da6e4-fd54-4f22-a517-7ef00b14280b tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:25.709061 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e8da6e4-fd54-4f22-a517-7ef00b14280b tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:25.713478 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e8da6e4-fd54-4f22-a517-7ef00b14280b tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:25.715669 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e8da6e4-fd54-4f22-a517-7ef00b14280b tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:25.717460 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e8da6e4-fd54-4f22-a517-7ef00b14280b tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:26.024982 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fb03ddd6-1195-4323-9625-be318fbfe610 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:26.025641 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fb03ddd6-1195-4323-9625-be318fbfe610 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:26.038160 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb03ddd6-1195-4323-9625-be318fbfe610 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:26.038650 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb03ddd6-1195-4323-9625-be318fbfe610 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:26.041357 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb03ddd6-1195-4323-9625-be318fbfe610 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:26.044397 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb03ddd6-1195-4323-9625-be318fbfe610 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:26.045055 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb03ddd6-1195-4323-9625-be318fbfe610 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:26.047961 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb03ddd6-1195-4323-9625-be318fbfe610 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:26.124036 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=100 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:26.139205 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1e8da6e4-fd54-4f22-a517-7ef00b14280b tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:26.153207 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1e8da6e4-fd54-4f22-a517-7ef00b14280b tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1315 microversion: 2.1 time: 0.486235 Sep 07 15:56:26.153802 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 48/92] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:25 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1315 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:26.603026 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-fb03ddd6-1195-4323-9625-be318fbfe610 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:26.618725 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fb03ddd6-1195-4323-9625-be318fbfe610 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1322 microversion: 2.1 time: 0.594505 Sep 07 15:56:26.621210 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 45/93] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:26 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1322 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:26.633915 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2284aa5d-459f-4db3-962f-670c84409ef9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:26.634772 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2284aa5d-459f-4db3-962f-670c84409ef9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:26.657052 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2284aa5d-459f-4db3-962f-670c84409ef9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:26.657595 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2284aa5d-459f-4db3-962f-670c84409ef9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:26.658027 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2284aa5d-459f-4db3-962f-670c84409ef9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:26.658809 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2284aa5d-459f-4db3-962f-670c84409ef9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:26.674703 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2284aa5d-459f-4db3-962f-670c84409ef9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:26.675329 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2284aa5d-459f-4db3-962f-670c84409ef9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:27.186783 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-83dd9bc3-4389-4234-a9f3-75794e5a8885 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:27.188503 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-83dd9bc3-4389-4234-a9f3-75794e5a8885 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:27.205674 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-83dd9bc3-4389-4234-a9f3-75794e5a8885 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:27.207136 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-83dd9bc3-4389-4234-a9f3-75794e5a8885 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:27.209382 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-83dd9bc3-4389-4234-a9f3-75794e5a8885 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:27.210411 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-83dd9bc3-4389-4234-a9f3-75794e5a8885 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:27.212592 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-83dd9bc3-4389-4234-a9f3-75794e5a8885 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:27.214116 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-83dd9bc3-4389-4234-a9f3-75794e5a8885 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:27.261051 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2284aa5d-459f-4db3-962f-670c84409ef9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:27.280111 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2284aa5d-459f-4db3-962f-670c84409ef9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:27.281572 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2284aa5d-459f-4db3-962f-670c84409ef9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:27.282974 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2284aa5d-459f-4db3-962f-670c84409ef9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1406 microversion: 2.20 time: 0.655298 Sep 07 15:56:27.283535 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 49/94] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:56:26 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1406 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:56:27.648341 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c2e42843-7b48-4e1c-a7c6-450e2e9d7dc8 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:27.649350 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c2e42843-7b48-4e1c-a7c6-450e2e9d7dc8 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:27.655463 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2e42843-7b48-4e1c-a7c6-450e2e9d7dc8 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:27.656394 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2e42843-7b48-4e1c-a7c6-450e2e9d7dc8 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:27.657047 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2e42843-7b48-4e1c-a7c6-450e2e9d7dc8 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:27.657954 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2e42843-7b48-4e1c-a7c6-450e2e9d7dc8 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:27.658850 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2e42843-7b48-4e1c-a7c6-450e2e9d7dc8 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:27.659471 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2e42843-7b48-4e1c-a7c6-450e2e9d7dc8 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:27.693197 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-83dd9bc3-4389-4234-a9f3-75794e5a8885 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:27.702464 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-83dd9bc3-4389-4234-a9f3-75794e5a8885 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1315 microversion: 2.1 time: 0.529734 Sep 07 15:56:27.703190 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 46/95] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:27 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1315 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:56:27.881047 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c2e42843-7b48-4e1c-a7c6-450e2e9d7dc8 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:27.888924 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c2e42843-7b48-4e1c-a7c6-450e2e9d7dc8 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1322 microversion: 2.1 time: 0.244327 Sep 07 15:56:27.889878 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 50/96] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:27 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1322 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:56:28.316996 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9fd7799d-8648-4a43-b1b3-9ce3368f820d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:28.318023 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9fd7799d-8648-4a43-b1b3-9ce3368f820d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:28.326355 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9fd7799d-8648-4a43-b1b3-9ce3368f820d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:28.327059 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9fd7799d-8648-4a43-b1b3-9ce3368f820d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:28.327727 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9fd7799d-8648-4a43-b1b3-9ce3368f820d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:28.329037 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9fd7799d-8648-4a43-b1b3-9ce3368f820d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:28.329828 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9fd7799d-8648-4a43-b1b3-9ce3368f820d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:28.333042 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9fd7799d-8648-4a43-b1b3-9ce3368f820d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:28.572675 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-9fd7799d-8648-4a43-b1b3-9ce3368f820d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:28.585100 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-9fd7799d-8648-4a43-b1b3-9ce3368f820d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:28.586736 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-9fd7799d-8648-4a43-b1b3-9ce3368f820d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:28.588100 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9fd7799d-8648-4a43-b1b3-9ce3368f820d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1406 microversion: 2.20 time: 0.278698 Sep 07 15:56:28.588839 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 47/97] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:56:28 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1406 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 15:56:28.730954 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8032d01d-abfe-4f3a-92ec-172e860a4bf9 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:28.731673 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8032d01d-abfe-4f3a-92ec-172e860a4bf9 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:28.742786 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8032d01d-abfe-4f3a-92ec-172e860a4bf9 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:28.743273 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8032d01d-abfe-4f3a-92ec-172e860a4bf9 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:28.743836 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8032d01d-abfe-4f3a-92ec-172e860a4bf9 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:28.744809 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8032d01d-abfe-4f3a-92ec-172e860a4bf9 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:28.745584 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8032d01d-abfe-4f3a-92ec-172e860a4bf9 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:28.746281 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8032d01d-abfe-4f3a-92ec-172e860a4bf9 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:28.917134 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9388b01f-d8a7-45aa-b1cd-ed7823949d63 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:28.917745 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9388b01f-d8a7-45aa-b1cd-ed7823949d63 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:28.920158 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-8032d01d-abfe-4f3a-92ec-172e860a4bf9 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:28.924155 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9388b01f-d8a7-45aa-b1cd-ed7823949d63 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:28.925008 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9388b01f-d8a7-45aa-b1cd-ed7823949d63 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:28.925432 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9388b01f-d8a7-45aa-b1cd-ed7823949d63 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:28.926304 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9388b01f-d8a7-45aa-b1cd-ed7823949d63 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:28.926988 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9388b01f-d8a7-45aa-b1cd-ed7823949d63 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:28.927601 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9388b01f-d8a7-45aa-b1cd-ed7823949d63 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:28.934121 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8032d01d-abfe-4f3a-92ec-172e860a4bf9 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1315 microversion: 2.1 time: 0.207659 Sep 07 15:56:28.936927 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 51/98] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:28 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:29.133897 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-9388b01f-d8a7-45aa-b1cd-ed7823949d63 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:29.142795 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9388b01f-d8a7-45aa-b1cd-ed7823949d63 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1322 microversion: 2.1 time: 0.229439 Sep 07 15:56:29.151623 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 48/99] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:28 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:29.615483 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ebcba72b-a8e6-43ff-aaf5-23c4a7bf24f1 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:29.616199 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ebcba72b-a8e6-43ff-aaf5-23c4a7bf24f1 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:29.625407 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ebcba72b-a8e6-43ff-aaf5-23c4a7bf24f1 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:29.625914 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ebcba72b-a8e6-43ff-aaf5-23c4a7bf24f1 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:29.626322 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ebcba72b-a8e6-43ff-aaf5-23c4a7bf24f1 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:29.631103 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ebcba72b-a8e6-43ff-aaf5-23c4a7bf24f1 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:29.631586 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ebcba72b-a8e6-43ff-aaf5-23c4a7bf24f1 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:29.632033 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ebcba72b-a8e6-43ff-aaf5-23c4a7bf24f1 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:29.937793 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ebcba72b-a8e6-43ff-aaf5-23c4a7bf24f1 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:29.957538 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ebcba72b-a8e6-43ff-aaf5-23c4a7bf24f1 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:29.960105 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ebcba72b-a8e6-43ff-aaf5-23c4a7bf24f1 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:29.962641 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ebcba72b-a8e6-43ff-aaf5-23c4a7bf24f1 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1406 microversion: 2.20 time: 0.350400 Sep 07 15:56:29.963402 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-781da269-4990-461e-b84c-3f7b67343c38 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:29.963997 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 52/100] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:56:29 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1406 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:56:29.964966 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-781da269-4990-461e-b84c-3f7b67343c38 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:29.967785 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:29.987406 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-781da269-4990-461e-b84c-3f7b67343c38 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:29.988241 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-781da269-4990-461e-b84c-3f7b67343c38 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:29.988832 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-781da269-4990-461e-b84c-3f7b67343c38 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:29.989588 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-781da269-4990-461e-b84c-3f7b67343c38 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:29.990231 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-781da269-4990-461e-b84c-3f7b67343c38 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:29.990805 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-781da269-4990-461e-b84c-3f7b67343c38 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:30.178562 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1456d85a-98cd-4a48-aca3-8363c61429f3 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:30.179180 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1456d85a-98cd-4a48-aca3-8363c61429f3 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:30.181129 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:30.194697 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1456d85a-98cd-4a48-aca3-8363c61429f3 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:30.195340 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1456d85a-98cd-4a48-aca3-8363c61429f3 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:30.196005 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1456d85a-98cd-4a48-aca3-8363c61429f3 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:30.197214 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1456d85a-98cd-4a48-aca3-8363c61429f3 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:30.198061 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1456d85a-98cd-4a48-aca3-8363c61429f3 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:30.198626 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1456d85a-98cd-4a48-aca3-8363c61429f3 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:30.290276 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-781da269-4990-461e-b84c-3f7b67343c38 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:30.306314 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-781da269-4990-461e-b84c-3f7b67343c38 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1315 microversion: 2.1 time: 0.349588 Sep 07 15:56:30.312403 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 49/101] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:29 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1315 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:56:30.363906 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1456d85a-98cd-4a48-aca3-8363c61429f3 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:30.375946 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1456d85a-98cd-4a48-aca3-8363c61429f3 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1322 microversion: 2.1 time: 0.212330 Sep 07 15:56:30.387347 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 53/102] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:30 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:56:30.996802 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-97df07a2-7b3d-41ba-9348-81f258a8b005 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:30.997570 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-97df07a2-7b3d-41ba-9348-81f258a8b005 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:31.007795 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-97df07a2-7b3d-41ba-9348-81f258a8b005 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:31.008331 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-97df07a2-7b3d-41ba-9348-81f258a8b005 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:31.008929 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-97df07a2-7b3d-41ba-9348-81f258a8b005 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:31.009762 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-97df07a2-7b3d-41ba-9348-81f258a8b005 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:31.010224 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-97df07a2-7b3d-41ba-9348-81f258a8b005 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:31.010649 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-97df07a2-7b3d-41ba-9348-81f258a8b005 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:31.297315 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-97df07a2-7b3d-41ba-9348-81f258a8b005 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:31.309460 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-97df07a2-7b3d-41ba-9348-81f258a8b005 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:31.310895 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-97df07a2-7b3d-41ba-9348-81f258a8b005 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:31.314426 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-97df07a2-7b3d-41ba-9348-81f258a8b005 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1406 microversion: 2.20 time: 0.327973 Sep 07 15:56:31.316464 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 50/103] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:56:30 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1406 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:56:31.341869 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fb45c91d-771a-4ee1-948d-9c0d3ad83095 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:31.344267 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fb45c91d-771a-4ee1-948d-9c0d3ad83095 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:31.351682 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:31.366882 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb45c91d-771a-4ee1-948d-9c0d3ad83095 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:31.367427 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb45c91d-771a-4ee1-948d-9c0d3ad83095 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:31.367823 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb45c91d-771a-4ee1-948d-9c0d3ad83095 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:31.368531 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb45c91d-771a-4ee1-948d-9c0d3ad83095 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:31.368979 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb45c91d-771a-4ee1-948d-9c0d3ad83095 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:31.374406 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb45c91d-771a-4ee1-948d-9c0d3ad83095 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:31.399292 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-01bcc012-341e-4895-a44c-651d516cdde5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:31.399962 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-01bcc012-341e-4895-a44c-651d516cdde5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:31.406421 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-01bcc012-341e-4895-a44c-651d516cdde5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:31.406905 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-01bcc012-341e-4895-a44c-651d516cdde5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:31.408450 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-01bcc012-341e-4895-a44c-651d516cdde5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:31.409945 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-01bcc012-341e-4895-a44c-651d516cdde5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:31.410443 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-01bcc012-341e-4895-a44c-651d516cdde5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:31.410871 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-01bcc012-341e-4895-a44c-651d516cdde5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:31.725062 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-fb45c91d-771a-4ee1-948d-9c0d3ad83095 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:31.739432 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fb45c91d-771a-4ee1-948d-9c0d3ad83095 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1315 microversion: 2.1 time: 0.405008 Sep 07 15:56:31.741919 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 54/104] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:31 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1315 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:31.755634 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-01bcc012-341e-4895-a44c-651d516cdde5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:31.763281 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-01bcc012-341e-4895-a44c-651d516cdde5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1322 microversion: 2.1 time: 0.367926 Sep 07 15:56:31.771583 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 51/105] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:31 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1322 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:56:32.344079 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-031c1639-89ee-4c75-831d-026213ca1ba8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:32.344839 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-031c1639-89ee-4c75-831d-026213ca1ba8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:32.351008 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-031c1639-89ee-4c75-831d-026213ca1ba8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:32.352140 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-031c1639-89ee-4c75-831d-026213ca1ba8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:32.352635 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-031c1639-89ee-4c75-831d-026213ca1ba8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:32.353396 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-031c1639-89ee-4c75-831d-026213ca1ba8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:32.353849 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-031c1639-89ee-4c75-831d-026213ca1ba8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:32.354267 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-031c1639-89ee-4c75-831d-026213ca1ba8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:32.519608 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-031c1639-89ee-4c75-831d-026213ca1ba8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:32.530778 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-031c1639-89ee-4c75-831d-026213ca1ba8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:32.532404 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-031c1639-89ee-4c75-831d-026213ca1ba8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:32.533528 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-031c1639-89ee-4c75-831d-026213ca1ba8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1406 microversion: 2.20 time: 0.194343 Sep 07 15:56:32.534116 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 55/106] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:56:32 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1406 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:56:32.769221 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-73ca2624-44e4-45b0-bcff-2affac550962 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:32.770730 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-73ca2624-44e4-45b0-bcff-2affac550962 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:32.777244 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:32.779290 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-73ca2624-44e4-45b0-bcff-2affac550962 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:32.780112 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-73ca2624-44e4-45b0-bcff-2affac550962 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:32.780691 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-73ca2624-44e4-45b0-bcff-2affac550962 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:32.781640 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-73ca2624-44e4-45b0-bcff-2affac550962 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:32.785910 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-73ca2624-44e4-45b0-bcff-2affac550962 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:32.786552 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-73ca2624-44e4-45b0-bcff-2affac550962 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:32.804077 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5e16a2ab-fde4-4e15-9192-d0d28b64f7ba tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:32.805104 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5e16a2ab-fde4-4e15-9192-d0d28b64f7ba tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:32.811962 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5e16a2ab-fde4-4e15-9192-d0d28b64f7ba tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:32.815899 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5e16a2ab-fde4-4e15-9192-d0d28b64f7ba tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:32.819916 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5e16a2ab-fde4-4e15-9192-d0d28b64f7ba tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:32.836761 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5e16a2ab-fde4-4e15-9192-d0d28b64f7ba tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:32.836761 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5e16a2ab-fde4-4e15-9192-d0d28b64f7ba tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:32.836761 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5e16a2ab-fde4-4e15-9192-d0d28b64f7ba tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:32.995225 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-73ca2624-44e4-45b0-bcff-2affac550962 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:33.004436 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-73ca2624-44e4-45b0-bcff-2affac550962 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1315 microversion: 2.1 time: 0.241632 Sep 07 15:56:33.005260 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 52/107] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:32 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:56:33.560113 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5e4ecf22-2cd7-4707-a4e6-d2f5fdb0609f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:33.561168 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5e4ecf22-2cd7-4707-a4e6-d2f5fdb0609f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:33.569718 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5e4ecf22-2cd7-4707-a4e6-d2f5fdb0609f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:33.570354 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5e4ecf22-2cd7-4707-a4e6-d2f5fdb0609f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:33.570926 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5e4ecf22-2cd7-4707-a4e6-d2f5fdb0609f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:33.571951 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5e4ecf22-2cd7-4707-a4e6-d2f5fdb0609f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:33.572918 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5e4ecf22-2cd7-4707-a4e6-d2f5fdb0609f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:33.573633 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5e4ecf22-2cd7-4707-a4e6-d2f5fdb0609f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:33.657818 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5e16a2ab-fde4-4e15-9192-d0d28b64f7ba tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:33.667297 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5e16a2ab-fde4-4e15-9192-d0d28b64f7ba tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1322 microversion: 2.1 time: 0.882191 Sep 07 15:56:33.670572 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 56/108] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:32 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1322 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:56:33.848157 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-5e4ecf22-2cd7-4707-a4e6-d2f5fdb0609f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:33.860807 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-5e4ecf22-2cd7-4707-a4e6-d2f5fdb0609f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:33.862533 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-5e4ecf22-2cd7-4707-a4e6-d2f5fdb0609f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:33.863714 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5e4ecf22-2cd7-4707-a4e6-d2f5fdb0609f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1406 microversion: 2.20 time: 0.308024 Sep 07 15:56:33.864632 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 53/109] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:56:33 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1406 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 15:56:34.027895 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-79d44d4e-708f-4512-81be-42e56f84e5d7 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:34.028734 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-79d44d4e-708f-4512-81be-42e56f84e5d7 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:34.039041 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-79d44d4e-708f-4512-81be-42e56f84e5d7 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:34.039608 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-79d44d4e-708f-4512-81be-42e56f84e5d7 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:34.040209 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-79d44d4e-708f-4512-81be-42e56f84e5d7 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:34.041069 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-79d44d4e-708f-4512-81be-42e56f84e5d7 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:34.041672 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-79d44d4e-708f-4512-81be-42e56f84e5d7 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:34.042503 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-79d44d4e-708f-4512-81be-42e56f84e5d7 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:34.334527 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-79d44d4e-708f-4512-81be-42e56f84e5d7 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:34.344427 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-79d44d4e-708f-4512-81be-42e56f84e5d7 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1315 microversion: 2.1 time: 0.320259 Sep 07 15:56:34.345332 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 57/110] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:34 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1315 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:34.697637 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fe98c71e-ce30-40c9-a3c5-db39058e3b1e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:34.698496 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fe98c71e-ce30-40c9-a3c5-db39058e3b1e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:34.706596 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fe98c71e-ce30-40c9-a3c5-db39058e3b1e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:34.709202 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fe98c71e-ce30-40c9-a3c5-db39058e3b1e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:34.709202 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fe98c71e-ce30-40c9-a3c5-db39058e3b1e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:34.710163 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fe98c71e-ce30-40c9-a3c5-db39058e3b1e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:34.710648 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fe98c71e-ce30-40c9-a3c5-db39058e3b1e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:34.711638 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fe98c71e-ce30-40c9-a3c5-db39058e3b1e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:34.878222 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-fe98c71e-ce30-40c9-a3c5-db39058e3b1e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:34.886690 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fe98c71e-ce30-40c9-a3c5-db39058e3b1e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1322 microversion: 2.1 time: 0.195019 Sep 07 15:56:34.887421 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 54/111] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:34 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:34.892363 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-006a2c12-3908-4ff4-9f42-a11381966477 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:34.896962 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-006a2c12-3908-4ff4-9f42-a11381966477 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:34.910618 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-006a2c12-3908-4ff4-9f42-a11381966477 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:34.911107 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-006a2c12-3908-4ff4-9f42-a11381966477 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:34.911561 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-006a2c12-3908-4ff4-9f42-a11381966477 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:34.912289 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-006a2c12-3908-4ff4-9f42-a11381966477 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:34.913190 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-006a2c12-3908-4ff4-9f42-a11381966477 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:34.913583 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-006a2c12-3908-4ff4-9f42-a11381966477 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:35.155977 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-006a2c12-3908-4ff4-9f42-a11381966477 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:35.172300 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-006a2c12-3908-4ff4-9f42-a11381966477 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:35.174047 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-006a2c12-3908-4ff4-9f42-a11381966477 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:35.175291 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-006a2c12-3908-4ff4-9f42-a11381966477 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1406 microversion: 2.20 time: 0.286896 Sep 07 15:56:35.176120 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 58/112] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:56:34 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1406 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:56:35.369677 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7eae6f24-8a90-4502-ae41-4c39db8301dc tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:35.370976 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7eae6f24-8a90-4502-ae41-4c39db8301dc tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:35.384924 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7eae6f24-8a90-4502-ae41-4c39db8301dc tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:35.388315 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7eae6f24-8a90-4502-ae41-4c39db8301dc tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:35.388978 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7eae6f24-8a90-4502-ae41-4c39db8301dc tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:35.389920 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7eae6f24-8a90-4502-ae41-4c39db8301dc tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:35.390433 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7eae6f24-8a90-4502-ae41-4c39db8301dc tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:35.390834 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7eae6f24-8a90-4502-ae41-4c39db8301dc tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:35.563677 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-7eae6f24-8a90-4502-ae41-4c39db8301dc tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:35.575585 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7eae6f24-8a90-4502-ae41-4c39db8301dc tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1315 microversion: 2.1 time: 0.210195 Sep 07 15:56:35.588173 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 55/113] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:35 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:35.914252 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9df88ab6-8c48-4ac8-a5ef-f3540bda0c06 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:35.914888 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9df88ab6-8c48-4ac8-a5ef-f3540bda0c06 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:35.921651 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9df88ab6-8c48-4ac8-a5ef-f3540bda0c06 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:35.922355 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9df88ab6-8c48-4ac8-a5ef-f3540bda0c06 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:35.922847 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9df88ab6-8c48-4ac8-a5ef-f3540bda0c06 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:35.923714 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9df88ab6-8c48-4ac8-a5ef-f3540bda0c06 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:35.924274 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9df88ab6-8c48-4ac8-a5ef-f3540bda0c06 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:35.925199 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9df88ab6-8c48-4ac8-a5ef-f3540bda0c06 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:36.110095 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9df88ab6-8c48-4ac8-a5ef-f3540bda0c06 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:36.117968 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9df88ab6-8c48-4ac8-a5ef-f3540bda0c06 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1322 microversion: 2.1 time: 0.208008 Sep 07 15:56:36.118545 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 59/114] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:35 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:36.211117 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-272ad110-e955-44ea-aa10-c0e7bd6b01e6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:36.212744 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-272ad110-e955-44ea-aa10-c0e7bd6b01e6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:36.219046 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-272ad110-e955-44ea-aa10-c0e7bd6b01e6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:36.219577 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-272ad110-e955-44ea-aa10-c0e7bd6b01e6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:36.220031 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-272ad110-e955-44ea-aa10-c0e7bd6b01e6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:36.220896 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-272ad110-e955-44ea-aa10-c0e7bd6b01e6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:36.221419 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-272ad110-e955-44ea-aa10-c0e7bd6b01e6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:36.222455 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-272ad110-e955-44ea-aa10-c0e7bd6b01e6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:36.373266 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-272ad110-e955-44ea-aa10-c0e7bd6b01e6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:36.383016 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-272ad110-e955-44ea-aa10-c0e7bd6b01e6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:36.384446 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-272ad110-e955-44ea-aa10-c0e7bd6b01e6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:36.385542 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-272ad110-e955-44ea-aa10-c0e7bd6b01e6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1406 microversion: 2.20 time: 0.183731 Sep 07 15:56:36.386085 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 56/115] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:56:36 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1406 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:56:36.601673 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-08467b68-ae84-4068-bea1-71b8c3cfc426 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:36.602521 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-08467b68-ae84-4068-bea1-71b8c3cfc426 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:36.608437 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08467b68-ae84-4068-bea1-71b8c3cfc426 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:36.608929 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08467b68-ae84-4068-bea1-71b8c3cfc426 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:36.609356 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08467b68-ae84-4068-bea1-71b8c3cfc426 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:36.610245 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08467b68-ae84-4068-bea1-71b8c3cfc426 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:36.610851 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08467b68-ae84-4068-bea1-71b8c3cfc426 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:36.611276 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08467b68-ae84-4068-bea1-71b8c3cfc426 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:36.775287 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-08467b68-ae84-4068-bea1-71b8c3cfc426 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:36.784614 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-08467b68-ae84-4068-bea1-71b8c3cfc426 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1315 microversion: 2.1 time: 0.187207 Sep 07 15:56:36.786605 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 60/116] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:36 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:37.140938 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7b81737e-2fb7-4488-b3ed-cebcba985f95 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:37.141667 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7b81737e-2fb7-4488-b3ed-cebcba985f95 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:37.148458 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b81737e-2fb7-4488-b3ed-cebcba985f95 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:37.148885 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b81737e-2fb7-4488-b3ed-cebcba985f95 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:37.149713 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b81737e-2fb7-4488-b3ed-cebcba985f95 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:37.150767 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b81737e-2fb7-4488-b3ed-cebcba985f95 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:37.151328 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b81737e-2fb7-4488-b3ed-cebcba985f95 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:37.151835 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b81737e-2fb7-4488-b3ed-cebcba985f95 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:37.297749 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-7b81737e-2fb7-4488-b3ed-cebcba985f95 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:37.305584 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7b81737e-2fb7-4488-b3ed-cebcba985f95 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1322 microversion: 2.1 time: 0.168496 Sep 07 15:56:37.306494 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 57/117] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:37 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:37.411929 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-599c2a2b-f4f8-4b7b-8c35-5759f2c4be6e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:37.413137 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-599c2a2b-f4f8-4b7b-8c35-5759f2c4be6e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:37.418981 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-599c2a2b-f4f8-4b7b-8c35-5759f2c4be6e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:37.419457 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-599c2a2b-f4f8-4b7b-8c35-5759f2c4be6e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:37.419913 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-599c2a2b-f4f8-4b7b-8c35-5759f2c4be6e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:37.420787 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-599c2a2b-f4f8-4b7b-8c35-5759f2c4be6e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:37.421411 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-599c2a2b-f4f8-4b7b-8c35-5759f2c4be6e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:37.422102 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-599c2a2b-f4f8-4b7b-8c35-5759f2c4be6e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:37.560562 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-599c2a2b-f4f8-4b7b-8c35-5759f2c4be6e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:37.564342 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:37.570472 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-599c2a2b-f4f8-4b7b-8c35-5759f2c4be6e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:37.572446 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-599c2a2b-f4f8-4b7b-8c35-5759f2c4be6e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:37.573694 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-599c2a2b-f4f8-4b7b-8c35-5759f2c4be6e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1406 microversion: 2.20 time: 0.166960 Sep 07 15:56:37.574240 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 61/118] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:56:37 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:56:37.808759 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ea2cf75c-4cd0-4baa-aa60-104103c48857 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:37.809445 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ea2cf75c-4cd0-4baa-aa60-104103c48857 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:37.817892 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea2cf75c-4cd0-4baa-aa60-104103c48857 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:37.818954 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea2cf75c-4cd0-4baa-aa60-104103c48857 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:37.819617 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea2cf75c-4cd0-4baa-aa60-104103c48857 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:37.820550 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea2cf75c-4cd0-4baa-aa60-104103c48857 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:37.821381 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea2cf75c-4cd0-4baa-aa60-104103c48857 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:37.828977 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ea2cf75c-4cd0-4baa-aa60-104103c48857 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:38.001951 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-ea2cf75c-4cd0-4baa-aa60-104103c48857 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:38.016246 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ea2cf75c-4cd0-4baa-aa60-104103c48857 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1315 microversion: 2.1 time: 0.211708 Sep 07 15:56:38.028178 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 58/119] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:37 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:38.329427 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c0afce6c-f815-45b2-a3c2-3c79528a28e9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:38.330308 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c0afce6c-f815-45b2-a3c2-3c79528a28e9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:38.336789 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0afce6c-f815-45b2-a3c2-3c79528a28e9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:38.337317 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0afce6c-f815-45b2-a3c2-3c79528a28e9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:38.337764 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0afce6c-f815-45b2-a3c2-3c79528a28e9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:38.338496 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0afce6c-f815-45b2-a3c2-3c79528a28e9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:38.339152 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0afce6c-f815-45b2-a3c2-3c79528a28e9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:38.339648 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c0afce6c-f815-45b2-a3c2-3c79528a28e9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:38.522704 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c0afce6c-f815-45b2-a3c2-3c79528a28e9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:38.531500 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c0afce6c-f815-45b2-a3c2-3c79528a28e9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1322 microversion: 2.1 time: 0.205557 Sep 07 15:56:38.532103 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 62/120] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:38 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:38.610625 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bb6ece95-75e7-464b-90a2-ad4ba06619c1 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:38.611421 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bb6ece95-75e7-464b-90a2-ad4ba06619c1 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:38.618511 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bb6ece95-75e7-464b-90a2-ad4ba06619c1 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:38.619067 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bb6ece95-75e7-464b-90a2-ad4ba06619c1 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:38.619736 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bb6ece95-75e7-464b-90a2-ad4ba06619c1 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:38.620754 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bb6ece95-75e7-464b-90a2-ad4ba06619c1 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:38.621483 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bb6ece95-75e7-464b-90a2-ad4ba06619c1 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:38.621868 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bb6ece95-75e7-464b-90a2-ad4ba06619c1 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:39.035203 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-bb6ece95-75e7-464b-90a2-ad4ba06619c1 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:39.039109 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5a8b75d0-4719-445e-a65c-dc71c93f94ea tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:39.039760 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5a8b75d0-4719-445e-a65c-dc71c93f94ea tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:39.046407 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a8b75d0-4719-445e-a65c-dc71c93f94ea tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:39.047071 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a8b75d0-4719-445e-a65c-dc71c93f94ea tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:39.047705 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a8b75d0-4719-445e-a65c-dc71c93f94ea tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:39.048541 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a8b75d0-4719-445e-a65c-dc71c93f94ea tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:39.049659 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a8b75d0-4719-445e-a65c-dc71c93f94ea tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:39.050234 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5a8b75d0-4719-445e-a65c-dc71c93f94ea tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:39.071044 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-bb6ece95-75e7-464b-90a2-ad4ba06619c1 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:39.083931 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-bb6ece95-75e7-464b-90a2-ad4ba06619c1 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:39.087886 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bb6ece95-75e7-464b-90a2-ad4ba06619c1 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1406 microversion: 2.20 time: 0.480134 Sep 07 15:56:39.108165 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 59/121] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:56:38 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1406 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:56:39.216934 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5a8b75d0-4719-445e-a65c-dc71c93f94ea tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:39.225655 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5a8b75d0-4719-445e-a65c-dc71c93f94ea tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1315 microversion: 2.1 time: 0.190239 Sep 07 15:56:39.226555 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 63/122] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:39 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:56:39.555585 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d2e6dd03-9975-47fc-b2af-6ce02e19d5f1 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:39.556199 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d2e6dd03-9975-47fc-b2af-6ce02e19d5f1 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:39.562132 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2e6dd03-9975-47fc-b2af-6ce02e19d5f1 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:39.562609 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2e6dd03-9975-47fc-b2af-6ce02e19d5f1 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:39.563039 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2e6dd03-9975-47fc-b2af-6ce02e19d5f1 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:39.563751 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2e6dd03-9975-47fc-b2af-6ce02e19d5f1 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:39.564202 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2e6dd03-9975-47fc-b2af-6ce02e19d5f1 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:39.564620 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2e6dd03-9975-47fc-b2af-6ce02e19d5f1 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:39.734005 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-d2e6dd03-9975-47fc-b2af-6ce02e19d5f1 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:39.742965 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d2e6dd03-9975-47fc-b2af-6ce02e19d5f1 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1322 microversion: 2.1 time: 0.191305 Sep 07 15:56:39.743666 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 60/123] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:39 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:40.130247 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b34b97b5-d050-4fa8-914f-4758c69b9cf9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:40.130887 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b34b97b5-d050-4fa8-914f-4758c69b9cf9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:40.137549 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b34b97b5-d050-4fa8-914f-4758c69b9cf9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:40.137647 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b34b97b5-d050-4fa8-914f-4758c69b9cf9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:40.138029 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b34b97b5-d050-4fa8-914f-4758c69b9cf9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:40.138741 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b34b97b5-d050-4fa8-914f-4758c69b9cf9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:40.139187 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b34b97b5-d050-4fa8-914f-4758c69b9cf9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:40.139632 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b34b97b5-d050-4fa8-914f-4758c69b9cf9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:40.248527 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6cb7d783-8ac9-4ba7-8055-39024ffe0366 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:40.249401 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6cb7d783-8ac9-4ba7-8055-39024ffe0366 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:40.255536 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6cb7d783-8ac9-4ba7-8055-39024ffe0366 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:40.256256 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6cb7d783-8ac9-4ba7-8055-39024ffe0366 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:40.256686 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6cb7d783-8ac9-4ba7-8055-39024ffe0366 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:40.257416 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6cb7d783-8ac9-4ba7-8055-39024ffe0366 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:40.258614 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6cb7d783-8ac9-4ba7-8055-39024ffe0366 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:40.259048 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6cb7d783-8ac9-4ba7-8055-39024ffe0366 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:40.290809 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b34b97b5-d050-4fa8-914f-4758c69b9cf9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:40.299815 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b34b97b5-d050-4fa8-914f-4758c69b9cf9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:40.301482 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b34b97b5-d050-4fa8-914f-4758c69b9cf9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:40.303004 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b34b97b5-d050-4fa8-914f-4758c69b9cf9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1406 microversion: 2.20 time: 0.176324 Sep 07 15:56:40.303782 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 64/124] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:56:40 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:56:40.419821 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-6cb7d783-8ac9-4ba7-8055-39024ffe0366 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:40.428318 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6cb7d783-8ac9-4ba7-8055-39024ffe0366 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1315 microversion: 2.1 time: 0.183533 Sep 07 15:56:40.428924 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 61/125] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:40 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:56:40.767283 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1b9b894d-108e-4392-80fc-c142b788d920 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:40.767992 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1b9b894d-108e-4392-80fc-c142b788d920 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:40.774175 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b9b894d-108e-4392-80fc-c142b788d920 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:40.774667 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b9b894d-108e-4392-80fc-c142b788d920 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:40.775089 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b9b894d-108e-4392-80fc-c142b788d920 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:40.775801 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b9b894d-108e-4392-80fc-c142b788d920 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:40.776243 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b9b894d-108e-4392-80fc-c142b788d920 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:40.776659 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b9b894d-108e-4392-80fc-c142b788d920 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:40.910443 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1b9b894d-108e-4392-80fc-c142b788d920 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:40.923094 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1b9b894d-108e-4392-80fc-c142b788d920 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1322 microversion: 2.1 time: 0.159927 Sep 07 15:56:40.932218 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 65/126] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:40 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:41.328426 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d2f25c60-2196-4ccb-ad93-21f6a15afbcd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:41.329197 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d2f25c60-2196-4ccb-ad93-21f6a15afbcd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:41.335529 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2f25c60-2196-4ccb-ad93-21f6a15afbcd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:41.336041 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2f25c60-2196-4ccb-ad93-21f6a15afbcd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:41.336467 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2f25c60-2196-4ccb-ad93-21f6a15afbcd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:41.337144 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2f25c60-2196-4ccb-ad93-21f6a15afbcd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:41.337587 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2f25c60-2196-4ccb-ad93-21f6a15afbcd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:41.338002 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2f25c60-2196-4ccb-ad93-21f6a15afbcd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:41.342005 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=100 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:41.451493 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-82797122-7eb4-4cf8-b2a0-5d9522a98279 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:41.452135 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-82797122-7eb4-4cf8-b2a0-5d9522a98279 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:41.458632 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82797122-7eb4-4cf8-b2a0-5d9522a98279 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:41.459110 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82797122-7eb4-4cf8-b2a0-5d9522a98279 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:41.459563 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82797122-7eb4-4cf8-b2a0-5d9522a98279 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:41.460257 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82797122-7eb4-4cf8-b2a0-5d9522a98279 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:41.461115 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82797122-7eb4-4cf8-b2a0-5d9522a98279 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:41.461115 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-82797122-7eb4-4cf8-b2a0-5d9522a98279 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:41.471574 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-d2f25c60-2196-4ccb-ad93-21f6a15afbcd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:41.481631 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-d2f25c60-2196-4ccb-ad93-21f6a15afbcd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:41.483210 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-d2f25c60-2196-4ccb-ad93-21f6a15afbcd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:41.484588 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d2f25c60-2196-4ccb-ad93-21f6a15afbcd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1406 microversion: 2.20 time: 0.160888 Sep 07 15:56:41.485448 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 62/127] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:56:41 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:56:41.595069 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-82797122-7eb4-4cf8-b2a0-5d9522a98279 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:41.605258 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-82797122-7eb4-4cf8-b2a0-5d9522a98279 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1315 microversion: 2.1 time: 0.157649 Sep 07 15:56:41.605817 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 66/128] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:41 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:56:41.946078 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9c3e083f-c646-4574-b1cf-ae476f8ad307 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:41.946778 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9c3e083f-c646-4574-b1cf-ae476f8ad307 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:41.953098 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c3e083f-c646-4574-b1cf-ae476f8ad307 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:41.953648 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c3e083f-c646-4574-b1cf-ae476f8ad307 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:41.954278 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c3e083f-c646-4574-b1cf-ae476f8ad307 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:41.954963 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c3e083f-c646-4574-b1cf-ae476f8ad307 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:41.955499 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c3e083f-c646-4574-b1cf-ae476f8ad307 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:41.956005 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c3e083f-c646-4574-b1cf-ae476f8ad307 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:42.084093 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-9c3e083f-c646-4574-b1cf-ae476f8ad307 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:42.094260 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9c3e083f-c646-4574-b1cf-ae476f8ad307 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1322 microversion: 2.1 time: 0.152006 Sep 07 15:56:42.094975 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 63/129] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:41 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:42.509946 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-269cc005-b4d2-43eb-9792-2f038062ef00 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:42.510596 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-269cc005-b4d2-43eb-9792-2f038062ef00 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:42.517495 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-269cc005-b4d2-43eb-9792-2f038062ef00 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:42.518069 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-269cc005-b4d2-43eb-9792-2f038062ef00 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:42.518500 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-269cc005-b4d2-43eb-9792-2f038062ef00 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:42.519170 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-269cc005-b4d2-43eb-9792-2f038062ef00 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:42.519643 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-269cc005-b4d2-43eb-9792-2f038062ef00 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:42.520058 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-269cc005-b4d2-43eb-9792-2f038062ef00 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:42.628029 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6e8fb2ad-2d7a-4f2e-ad48-65d9b8c6b1cd tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:42.628634 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6e8fb2ad-2d7a-4f2e-ad48-65d9b8c6b1cd tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:42.634430 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e8fb2ad-2d7a-4f2e-ad48-65d9b8c6b1cd tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:42.635226 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e8fb2ad-2d7a-4f2e-ad48-65d9b8c6b1cd tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:42.635696 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e8fb2ad-2d7a-4f2e-ad48-65d9b8c6b1cd tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:42.636378 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e8fb2ad-2d7a-4f2e-ad48-65d9b8c6b1cd tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:42.636834 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e8fb2ad-2d7a-4f2e-ad48-65d9b8c6b1cd tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:42.637255 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6e8fb2ad-2d7a-4f2e-ad48-65d9b8c6b1cd tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:42.650020 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-269cc005-b4d2-43eb-9792-2f038062ef00 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:42.658020 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-269cc005-b4d2-43eb-9792-2f038062ef00 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:42.659978 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-269cc005-b4d2-43eb-9792-2f038062ef00 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:42.661077 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-269cc005-b4d2-43eb-9792-2f038062ef00 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1406 microversion: 2.20 time: 0.156281 Sep 07 15:56:42.661624 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 67/130] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:56:42 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:56:42.770216 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-6e8fb2ad-2d7a-4f2e-ad48-65d9b8c6b1cd tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:42.778904 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6e8fb2ad-2d7a-4f2e-ad48-65d9b8c6b1cd tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1315 microversion: 2.1 time: 0.154660 Sep 07 15:56:42.779627 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 64/131] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:42 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:56:43.118235 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3573e3d2-f98a-466c-a94a-e61d562e4300 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:43.118831 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3573e3d2-f98a-466c-a94a-e61d562e4300 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:43.124637 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3573e3d2-f98a-466c-a94a-e61d562e4300 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:43.125115 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3573e3d2-f98a-466c-a94a-e61d562e4300 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:43.125536 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3573e3d2-f98a-466c-a94a-e61d562e4300 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:43.126212 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3573e3d2-f98a-466c-a94a-e61d562e4300 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:43.126655 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3573e3d2-f98a-466c-a94a-e61d562e4300 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:43.127198 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3573e3d2-f98a-466c-a94a-e61d562e4300 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:43.254429 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3573e3d2-f98a-466c-a94a-e61d562e4300 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:43.262113 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3573e3d2-f98a-466c-a94a-e61d562e4300 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1322 microversion: 2.1 time: 0.147552 Sep 07 15:56:43.262668 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 68/132] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:43 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:43.686483 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-af9a0bd7-91b4-4c93-9a56-0cc989f6ea8b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:43.687097 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-af9a0bd7-91b4-4c93-9a56-0cc989f6ea8b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:43.693667 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-af9a0bd7-91b4-4c93-9a56-0cc989f6ea8b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:43.694141 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-af9a0bd7-91b4-4c93-9a56-0cc989f6ea8b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:43.694571 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-af9a0bd7-91b4-4c93-9a56-0cc989f6ea8b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:43.695248 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-af9a0bd7-91b4-4c93-9a56-0cc989f6ea8b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:43.695733 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-af9a0bd7-91b4-4c93-9a56-0cc989f6ea8b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:43.696150 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-af9a0bd7-91b4-4c93-9a56-0cc989f6ea8b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:43.805095 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b63a7aa4-18bf-4c2c-b6bc-cda1fba890ad tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:43.805975 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b63a7aa4-18bf-4c2c-b6bc-cda1fba890ad tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:43.813340 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b63a7aa4-18bf-4c2c-b6bc-cda1fba890ad tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:43.813993 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b63a7aa4-18bf-4c2c-b6bc-cda1fba890ad tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:43.815173 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b63a7aa4-18bf-4c2c-b6bc-cda1fba890ad tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:43.816144 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b63a7aa4-18bf-4c2c-b6bc-cda1fba890ad tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:43.816719 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b63a7aa4-18bf-4c2c-b6bc-cda1fba890ad tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:43.817483 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b63a7aa4-18bf-4c2c-b6bc-cda1fba890ad tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:43.832892 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-af9a0bd7-91b4-4c93-9a56-0cc989f6ea8b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:43.847262 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-af9a0bd7-91b4-4c93-9a56-0cc989f6ea8b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:43.849200 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-af9a0bd7-91b4-4c93-9a56-0cc989f6ea8b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:43.850573 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-af9a0bd7-91b4-4c93-9a56-0cc989f6ea8b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1406 microversion: 2.20 time: 0.168013 Sep 07 15:56:43.851802 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 65/133] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:56:43 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:56:43.972669 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b63a7aa4-18bf-4c2c-b6bc-cda1fba890ad tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:43.980511 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b63a7aa4-18bf-4c2c-b6bc-cda1fba890ad tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1315 microversion: 2.1 time: 0.182059 Sep 07 15:56:43.981061 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 69/134] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:43 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:56:44.285697 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-203e95ad-a9aa-4e92-9d77-e7967701bb52 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:44.286296 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-203e95ad-a9aa-4e92-9d77-e7967701bb52 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:44.292271 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-203e95ad-a9aa-4e92-9d77-e7967701bb52 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:44.292691 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-203e95ad-a9aa-4e92-9d77-e7967701bb52 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:44.293121 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-203e95ad-a9aa-4e92-9d77-e7967701bb52 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:44.293799 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-203e95ad-a9aa-4e92-9d77-e7967701bb52 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:44.294249 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-203e95ad-a9aa-4e92-9d77-e7967701bb52 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:44.294671 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-203e95ad-a9aa-4e92-9d77-e7967701bb52 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:44.420333 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-203e95ad-a9aa-4e92-9d77-e7967701bb52 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:44.428930 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-203e95ad-a9aa-4e92-9d77-e7967701bb52 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1322 microversion: 2.1 time: 0.147007 Sep 07 15:56:44.429475 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 66/135] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:44 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:44.876433 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-64008bff-e112-4ec0-a1f0-8d01a6d657f3 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:44.877091 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-64008bff-e112-4ec0-a1f0-8d01a6d657f3 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:44.882987 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64008bff-e112-4ec0-a1f0-8d01a6d657f3 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:44.883465 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64008bff-e112-4ec0-a1f0-8d01a6d657f3 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:44.883940 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64008bff-e112-4ec0-a1f0-8d01a6d657f3 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:44.884663 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64008bff-e112-4ec0-a1f0-8d01a6d657f3 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:44.885055 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64008bff-e112-4ec0-a1f0-8d01a6d657f3 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:44.885474 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64008bff-e112-4ec0-a1f0-8d01a6d657f3 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:45.003536 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bdc70d53-19f4-49ba-868e-294bf977b923 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:45.004153 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bdc70d53-19f4-49ba-868e-294bf977b923 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:45.009942 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bdc70d53-19f4-49ba-868e-294bf977b923 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:45.010420 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bdc70d53-19f4-49ba-868e-294bf977b923 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:45.011121 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bdc70d53-19f4-49ba-868e-294bf977b923 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:45.012086 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bdc70d53-19f4-49ba-868e-294bf977b923 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:45.012785 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bdc70d53-19f4-49ba-868e-294bf977b923 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:45.013238 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bdc70d53-19f4-49ba-868e-294bf977b923 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:45.014308 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-64008bff-e112-4ec0-a1f0-8d01a6d657f3 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:45.023283 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-64008bff-e112-4ec0-a1f0-8d01a6d657f3 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:45.024759 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-64008bff-e112-4ec0-a1f0-8d01a6d657f3 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:45.025888 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-64008bff-e112-4ec0-a1f0-8d01a6d657f3 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1406 microversion: 2.20 time: 0.153342 Sep 07 15:56:45.026498 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 70/136] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:56:44 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:56:45.148324 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-bdc70d53-19f4-49ba-868e-294bf977b923 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:45.156155 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bdc70d53-19f4-49ba-868e-294bf977b923 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1315 microversion: 2.1 time: 0.156407 Sep 07 15:56:45.156797 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 67/137] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:44 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:45.451818 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f8aa5442-2af1-409b-b1f7-5d2976b97169 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:45.452507 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f8aa5442-2af1-409b-b1f7-5d2976b97169 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:45.459069 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8aa5442-2af1-409b-b1f7-5d2976b97169 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:45.459576 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8aa5442-2af1-409b-b1f7-5d2976b97169 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:45.460005 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8aa5442-2af1-409b-b1f7-5d2976b97169 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:45.461383 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8aa5442-2af1-409b-b1f7-5d2976b97169 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:45.461383 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8aa5442-2af1-409b-b1f7-5d2976b97169 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:45.461573 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8aa5442-2af1-409b-b1f7-5d2976b97169 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:45.595921 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f8aa5442-2af1-409b-b1f7-5d2976b97169 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:45.603721 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f8aa5442-2af1-409b-b1f7-5d2976b97169 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1322 microversion: 2.1 time: 0.155857 Sep 07 15:56:45.604274 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 71/138] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:45 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:46.052165 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-575e9cd1-2951-4b68-8705-e4ecaacc4673 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:46.052751 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-575e9cd1-2951-4b68-8705-e4ecaacc4673 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:46.058559 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-575e9cd1-2951-4b68-8705-e4ecaacc4673 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:46.059034 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-575e9cd1-2951-4b68-8705-e4ecaacc4673 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:46.059461 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-575e9cd1-2951-4b68-8705-e4ecaacc4673 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:46.060157 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-575e9cd1-2951-4b68-8705-e4ecaacc4673 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:46.060601 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-575e9cd1-2951-4b68-8705-e4ecaacc4673 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:46.061013 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-575e9cd1-2951-4b68-8705-e4ecaacc4673 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:46.178636 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3dfa22b3-6263-44ca-a110-f0bcc7144cbd tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:46.179247 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3dfa22b3-6263-44ca-a110-f0bcc7144cbd tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:46.187008 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3dfa22b3-6263-44ca-a110-f0bcc7144cbd tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:46.187885 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3dfa22b3-6263-44ca-a110-f0bcc7144cbd tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:46.188471 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3dfa22b3-6263-44ca-a110-f0bcc7144cbd tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:46.190165 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3dfa22b3-6263-44ca-a110-f0bcc7144cbd tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:46.190775 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3dfa22b3-6263-44ca-a110-f0bcc7144cbd tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:46.191345 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3dfa22b3-6263-44ca-a110-f0bcc7144cbd tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:46.238741 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-575e9cd1-2951-4b68-8705-e4ecaacc4673 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:46.249482 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-575e9cd1-2951-4b68-8705-e4ecaacc4673 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:46.251090 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-575e9cd1-2951-4b68-8705-e4ecaacc4673 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:46.253237 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-575e9cd1-2951-4b68-8705-e4ecaacc4673 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1406 microversion: 2.20 time: 0.205193 Sep 07 15:56:46.265072 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 68/139] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:56:46 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1406 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:56:46.360825 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3dfa22b3-6263-44ca-a110-f0bcc7144cbd tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:46.368421 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3dfa22b3-6263-44ca-a110-f0bcc7144cbd tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1315 microversion: 2.1 time: 0.194142 Sep 07 15:56:46.368968 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 72/140] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:46 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:56:46.627115 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2298f063-3309-4327-a016-c61aca7f88fe tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:46.627753 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2298f063-3309-4327-a016-c61aca7f88fe tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:46.634280 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2298f063-3309-4327-a016-c61aca7f88fe tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:46.634794 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2298f063-3309-4327-a016-c61aca7f88fe tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:46.635206 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2298f063-3309-4327-a016-c61aca7f88fe tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:46.635940 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2298f063-3309-4327-a016-c61aca7f88fe tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:46.636391 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2298f063-3309-4327-a016-c61aca7f88fe tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:46.636815 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2298f063-3309-4327-a016-c61aca7f88fe tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:46.781214 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-2298f063-3309-4327-a016-c61aca7f88fe tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:46.788817 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2298f063-3309-4327-a016-c61aca7f88fe tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1322 microversion: 2.1 time: 0.165956 Sep 07 15:56:46.789377 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 69/141] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:46 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:47.290304 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bafb67bf-9263-4041-8021-b49a311e7e7a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:47.291487 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bafb67bf-9263-4041-8021-b49a311e7e7a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:47.299576 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bafb67bf-9263-4041-8021-b49a311e7e7a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:47.300465 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bafb67bf-9263-4041-8021-b49a311e7e7a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:47.301159 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bafb67bf-9263-4041-8021-b49a311e7e7a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:47.302609 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bafb67bf-9263-4041-8021-b49a311e7e7a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:47.303613 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bafb67bf-9263-4041-8021-b49a311e7e7a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:47.304261 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bafb67bf-9263-4041-8021-b49a311e7e7a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:47.390503 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-30e517ed-85fd-4d39-ab46-5c1f2c1230c0 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:47.391119 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-30e517ed-85fd-4d39-ab46-5c1f2c1230c0 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:47.400047 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-30e517ed-85fd-4d39-ab46-5c1f2c1230c0 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:47.400724 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-30e517ed-85fd-4d39-ab46-5c1f2c1230c0 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:47.405859 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-30e517ed-85fd-4d39-ab46-5c1f2c1230c0 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:47.407108 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-30e517ed-85fd-4d39-ab46-5c1f2c1230c0 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:47.408559 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-30e517ed-85fd-4d39-ab46-5c1f2c1230c0 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:47.409202 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-30e517ed-85fd-4d39-ab46-5c1f2c1230c0 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:47.488157 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-bafb67bf-9263-4041-8021-b49a311e7e7a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:47.498531 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-bafb67bf-9263-4041-8021-b49a311e7e7a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:47.499996 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-bafb67bf-9263-4041-8021-b49a311e7e7a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:47.501355 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bafb67bf-9263-4041-8021-b49a311e7e7a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1406 microversion: 2.20 time: 0.218890 Sep 07 15:56:47.502745 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 73/142] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:56:47 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1406 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:56:47.602742 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-30e517ed-85fd-4d39-ab46-5c1f2c1230c0 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:47.612106 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-30e517ed-85fd-4d39-ab46-5c1f2c1230c0 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1315 microversion: 2.1 time: 0.225375 Sep 07 15:56:47.628017 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 70/143] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:47 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:47.815703 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b5b02737-afb6-4196-8f6a-1af18dc28b9f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:47.816837 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b5b02737-afb6-4196-8f6a-1af18dc28b9f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:47.824794 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5b02737-afb6-4196-8f6a-1af18dc28b9f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:47.825638 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5b02737-afb6-4196-8f6a-1af18dc28b9f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:47.826452 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5b02737-afb6-4196-8f6a-1af18dc28b9f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:47.827726 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5b02737-afb6-4196-8f6a-1af18dc28b9f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:47.828355 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5b02737-afb6-4196-8f6a-1af18dc28b9f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:47.829153 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b5b02737-afb6-4196-8f6a-1af18dc28b9f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:48.035144 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b5b02737-afb6-4196-8f6a-1af18dc28b9f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:48.042957 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b5b02737-afb6-4196-8f6a-1af18dc28b9f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1322 microversion: 2.1 time: 0.234549 Sep 07 15:56:48.043534 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 74/144] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:47 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1322 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:48.118949 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-689185c4-7a3b-4e9e-8840-531041abe409 req-998a18b7-27af-4631-b277-1060009faad2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "881d1d65-f44f-40d2-9e0e-01f29e5bd88a", "name": "network-vif-plugged", "status": "completed", "tag": "ae90bf0e-889b-437f-8ebd-f3878af5201c"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:56:48.130982 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-689185c4-7a3b-4e9e-8840-531041abe409 req-998a18b7-27af-4631-b277-1060009faad2 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:48.131259 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-689185c4-7a3b-4e9e-8840-531041abe409 req-998a18b7-27af-4631-b277-1060009faad2 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:48.131711 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-689185c4-7a3b-4e9e-8840-531041abe409 req-998a18b7-27af-4631-b277-1060009faad2 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:48.155769 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-689185c4-7a3b-4e9e-8840-531041abe409 req-998a18b7-27af-4631-b277-1060009faad2 service nova] Creating event network-vif-plugged:ae90bf0e-889b-437f-8ebd-f3878af5201c for instance 881d1d65-f44f-40d2-9e0e-01f29e5bd88a on hv-cinder-85331 Sep 07 15:56:48.162881 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-689185c4-7a3b-4e9e-8840-531041abe409 req-998a18b7-27af-4631-b277-1060009faad2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129941 Sep 07 15:56:48.163693 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 71/145] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 15:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 15:56:48.529766 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-23b7f5a3-836b-4206-b7e2-8111b53ff918 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:48.530382 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-23b7f5a3-836b-4206-b7e2-8111b53ff918 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:48.537242 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-23b7f5a3-836b-4206-b7e2-8111b53ff918 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:48.537731 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-23b7f5a3-836b-4206-b7e2-8111b53ff918 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:48.538163 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-23b7f5a3-836b-4206-b7e2-8111b53ff918 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:48.538858 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-23b7f5a3-836b-4206-b7e2-8111b53ff918 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:48.539305 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-23b7f5a3-836b-4206-b7e2-8111b53ff918 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:48.539757 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-23b7f5a3-836b-4206-b7e2-8111b53ff918 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:48.641238 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-20575c40-263a-4ef6-bad6-7dd41b0adbee tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:48.642873 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-20575c40-263a-4ef6-bad6-7dd41b0adbee tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:48.651438 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-20575c40-263a-4ef6-bad6-7dd41b0adbee tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:48.652373 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-20575c40-263a-4ef6-bad6-7dd41b0adbee tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:48.653208 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-20575c40-263a-4ef6-bad6-7dd41b0adbee tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:48.654665 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-20575c40-263a-4ef6-bad6-7dd41b0adbee tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:48.655368 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-20575c40-263a-4ef6-bad6-7dd41b0adbee tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:48.656089 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-20575c40-263a-4ef6-bad6-7dd41b0adbee tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:48.704561 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-23b7f5a3-836b-4206-b7e2-8111b53ff918 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:48.714632 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-23b7f5a3-836b-4206-b7e2-8111b53ff918 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:48.716153 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-23b7f5a3-836b-4206-b7e2-8111b53ff918 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:48.717745 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-23b7f5a3-836b-4206-b7e2-8111b53ff918 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1406 microversion: 2.20 time: 0.192280 Sep 07 15:56:48.718716 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 75/146] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:56:48 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1406 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:56:48.864646 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-20575c40-263a-4ef6-bad6-7dd41b0adbee tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:48.873106 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-20575c40-263a-4ef6-bad6-7dd41b0adbee tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1315 microversion: 2.1 time: 0.237922 Sep 07 15:56:48.873708 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 72/147] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:48 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:49.070141 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8065dc37-d6c8-4498-9a79-2c81e481bfb9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:49.070862 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8065dc37-d6c8-4498-9a79-2c81e481bfb9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:49.077977 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8065dc37-d6c8-4498-9a79-2c81e481bfb9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:49.078411 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8065dc37-d6c8-4498-9a79-2c81e481bfb9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:49.078834 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8065dc37-d6c8-4498-9a79-2c81e481bfb9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:49.079726 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8065dc37-d6c8-4498-9a79-2c81e481bfb9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:49.087160 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8065dc37-d6c8-4498-9a79-2c81e481bfb9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:49.087686 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8065dc37-d6c8-4498-9a79-2c81e481bfb9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:49.244260 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-8065dc37-d6c8-4498-9a79-2c81e481bfb9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:49.254438 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8065dc37-d6c8-4498-9a79-2c81e481bfb9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1322 microversion: 2.1 time: 0.190086 Sep 07 15:56:49.255235 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 76/148] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:49 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:56:49.747896 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-796f315f-8324-4b98-8103-5ed152e43bfd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:49.748496 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-796f315f-8324-4b98-8103-5ed152e43bfd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:49.754686 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-796f315f-8324-4b98-8103-5ed152e43bfd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:49.755163 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-796f315f-8324-4b98-8103-5ed152e43bfd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:49.755609 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-796f315f-8324-4b98-8103-5ed152e43bfd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:49.756407 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-796f315f-8324-4b98-8103-5ed152e43bfd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:49.757095 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-796f315f-8324-4b98-8103-5ed152e43bfd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:49.757452 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-796f315f-8324-4b98-8103-5ed152e43bfd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:49.898866 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-60a594dc-76bf-4d88-8f1c-1e68b316f684 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:49.900502 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-60a594dc-76bf-4d88-8f1c-1e68b316f684 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:49.908919 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60a594dc-76bf-4d88-8f1c-1e68b316f684 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:49.909710 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60a594dc-76bf-4d88-8f1c-1e68b316f684 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:49.910358 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60a594dc-76bf-4d88-8f1c-1e68b316f684 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:49.911577 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60a594dc-76bf-4d88-8f1c-1e68b316f684 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:49.912302 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60a594dc-76bf-4d88-8f1c-1e68b316f684 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:49.912801 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60a594dc-76bf-4d88-8f1c-1e68b316f684 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:49.921908 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-796f315f-8324-4b98-8103-5ed152e43bfd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:49.931469 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-796f315f-8324-4b98-8103-5ed152e43bfd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:49.933148 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-796f315f-8324-4b98-8103-5ed152e43bfd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:49.934620 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-796f315f-8324-4b98-8103-5ed152e43bfd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1406 microversion: 2.20 time: 0.190783 Sep 07 15:56:49.935899 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 73/149] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:56:49 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1406 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:56:50.079935 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-60a594dc-76bf-4d88-8f1c-1e68b316f684 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:50.093200 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-60a594dc-76bf-4d88-8f1c-1e68b316f684 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1315 microversion: 2.1 time: 0.199383 Sep 07 15:56:50.094368 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 77/150] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:49 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:50.277804 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-57ca6fb4-ef6c-4c5c-b977-feb6d054749a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:50.278839 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-57ca6fb4-ef6c-4c5c-b977-feb6d054749a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:50.288443 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-57ca6fb4-ef6c-4c5c-b977-feb6d054749a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:50.289013 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-57ca6fb4-ef6c-4c5c-b977-feb6d054749a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:50.289511 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-57ca6fb4-ef6c-4c5c-b977-feb6d054749a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:50.290256 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-57ca6fb4-ef6c-4c5c-b977-feb6d054749a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:50.290957 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-57ca6fb4-ef6c-4c5c-b977-feb6d054749a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:50.291757 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-57ca6fb4-ef6c-4c5c-b977-feb6d054749a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:50.459480 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-57ca6fb4-ef6c-4c5c-b977-feb6d054749a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:50.473775 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-57ca6fb4-ef6c-4c5c-b977-feb6d054749a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1322 microversion: 2.1 time: 0.198561 Sep 07 15:56:50.474362 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 74/151] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:50 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:50.961429 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-deb5f29f-81a1-4a06-8300-50ac60066d0a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:50.962030 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-deb5f29f-81a1-4a06-8300-50ac60066d0a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:50.970817 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-deb5f29f-81a1-4a06-8300-50ac60066d0a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:50.971416 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-deb5f29f-81a1-4a06-8300-50ac60066d0a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:50.971997 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-deb5f29f-81a1-4a06-8300-50ac60066d0a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:50.972759 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-deb5f29f-81a1-4a06-8300-50ac60066d0a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:50.973665 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-deb5f29f-81a1-4a06-8300-50ac60066d0a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:50.974093 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-deb5f29f-81a1-4a06-8300-50ac60066d0a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:50.994708 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:51.116997 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6ff94100-1425-4233-a6cc-e960f7a547d8 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:51.117803 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6ff94100-1425-4233-a6cc-e960f7a547d8 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:51.119428 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-deb5f29f-81a1-4a06-8300-50ac60066d0a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:51.128334 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ff94100-1425-4233-a6cc-e960f7a547d8 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:51.129046 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ff94100-1425-4233-a6cc-e960f7a547d8 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:51.129734 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ff94100-1425-4233-a6cc-e960f7a547d8 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:51.130485 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ff94100-1425-4233-a6cc-e960f7a547d8 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:51.130720 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-deb5f29f-81a1-4a06-8300-50ac60066d0a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:51.131188 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ff94100-1425-4233-a6cc-e960f7a547d8 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:51.131716 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ff94100-1425-4233-a6cc-e960f7a547d8 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:51.132779 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-deb5f29f-81a1-4a06-8300-50ac60066d0a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:51.133900 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-deb5f29f-81a1-4a06-8300-50ac60066d0a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1406 microversion: 2.20 time: 0.176278 Sep 07 15:56:51.134739 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 78/152] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:56:50 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 15:56:51.288684 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-6ff94100-1425-4233-a6cc-e960f7a547d8 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:51.296635 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6ff94100-1425-4233-a6cc-e960f7a547d8 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1315 microversion: 2.1 time: 0.183611 Sep 07 15:56:51.297140 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 75/153] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:51 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:56:51.499283 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-41fdaa0c-8a58-4766-b3ed-cf73775ea392 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:51.500198 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-41fdaa0c-8a58-4766-b3ed-cf73775ea392 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:51.506760 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41fdaa0c-8a58-4766-b3ed-cf73775ea392 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:51.507243 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41fdaa0c-8a58-4766-b3ed-cf73775ea392 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:51.507897 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41fdaa0c-8a58-4766-b3ed-cf73775ea392 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:51.508583 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41fdaa0c-8a58-4766-b3ed-cf73775ea392 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:51.509032 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41fdaa0c-8a58-4766-b3ed-cf73775ea392 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:51.509627 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-41fdaa0c-8a58-4766-b3ed-cf73775ea392 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:51.649893 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-41fdaa0c-8a58-4766-b3ed-cf73775ea392 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:51.657357 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-41fdaa0c-8a58-4766-b3ed-cf73775ea392 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1322 microversion: 2.1 time: 0.161800 Sep 07 15:56:51.658440 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 79/154] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:51 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:52.158188 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d60228e4-4d16-465b-9688-7d6c51e52585 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:52.158944 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d60228e4-4d16-465b-9688-7d6c51e52585 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:52.164934 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d60228e4-4d16-465b-9688-7d6c51e52585 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:52.165418 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d60228e4-4d16-465b-9688-7d6c51e52585 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:52.165846 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d60228e4-4d16-465b-9688-7d6c51e52585 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:52.166564 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d60228e4-4d16-465b-9688-7d6c51e52585 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:52.167011 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d60228e4-4d16-465b-9688-7d6c51e52585 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:52.167430 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d60228e4-4d16-465b-9688-7d6c51e52585 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:52.300187 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-d60228e4-4d16-465b-9688-7d6c51e52585 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:52.308134 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-d60228e4-4d16-465b-9688-7d6c51e52585 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:52.309655 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-d60228e4-4d16-465b-9688-7d6c51e52585 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:52.310728 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d60228e4-4d16-465b-9688-7d6c51e52585 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1406 microversion: 2.20 time: 0.156491 Sep 07 15:56:52.311304 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 76/155] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:56:52 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:56:52.319989 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-99119c30-bdca-42da-a7ea-f097c93d79e1 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:52.320853 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-99119c30-bdca-42da-a7ea-f097c93d79e1 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:52.327065 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99119c30-bdca-42da-a7ea-f097c93d79e1 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:52.327577 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99119c30-bdca-42da-a7ea-f097c93d79e1 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:52.328010 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99119c30-bdca-42da-a7ea-f097c93d79e1 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:52.329076 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99119c30-bdca-42da-a7ea-f097c93d79e1 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:52.329616 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99119c30-bdca-42da-a7ea-f097c93d79e1 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:52.330275 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99119c30-bdca-42da-a7ea-f097c93d79e1 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:52.468268 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-99119c30-bdca-42da-a7ea-f097c93d79e1 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:52.477133 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-99119c30-bdca-42da-a7ea-f097c93d79e1 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1315 microversion: 2.1 time: 0.160865 Sep 07 15:56:52.477949 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 80/156] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:52 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:52.680520 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0e156e45-482d-4418-87cb-33dd210695c7 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:52.681564 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0e156e45-482d-4418-87cb-33dd210695c7 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:52.687595 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e156e45-482d-4418-87cb-33dd210695c7 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:52.688157 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e156e45-482d-4418-87cb-33dd210695c7 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:52.688860 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e156e45-482d-4418-87cb-33dd210695c7 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:52.689689 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e156e45-482d-4418-87cb-33dd210695c7 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:52.690233 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e156e45-482d-4418-87cb-33dd210695c7 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:52.690886 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e156e45-482d-4418-87cb-33dd210695c7 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:52.844060 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-0e156e45-482d-4418-87cb-33dd210695c7 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:52.852814 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0e156e45-482d-4418-87cb-33dd210695c7 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1322 microversion: 2.1 time: 0.176176 Sep 07 15:56:52.853658 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 77/157] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:52 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:53.336398 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2c17cc05-9706-404f-bda0-0481665d9122 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:53.337135 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2c17cc05-9706-404f-bda0-0481665d9122 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:53.343086 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c17cc05-9706-404f-bda0-0481665d9122 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:53.343595 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c17cc05-9706-404f-bda0-0481665d9122 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:53.344033 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c17cc05-9706-404f-bda0-0481665d9122 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:53.344718 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c17cc05-9706-404f-bda0-0481665d9122 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:53.345174 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c17cc05-9706-404f-bda0-0481665d9122 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:53.345650 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c17cc05-9706-404f-bda0-0481665d9122 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:53.475245 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2c17cc05-9706-404f-bda0-0481665d9122 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:53.483863 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2c17cc05-9706-404f-bda0-0481665d9122 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:53.485412 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2c17cc05-9706-404f-bda0-0481665d9122 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:53.487087 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2c17cc05-9706-404f-bda0-0481665d9122 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1406 microversion: 2.20 time: 0.154533 Sep 07 15:56:53.487648 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 81/158] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:56:53 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:56:53.500034 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b2337f0d-6d13-4a12-bfd0-94768045da8f tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:53.501452 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b2337f0d-6d13-4a12-bfd0-94768045da8f tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:53.507463 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b2337f0d-6d13-4a12-bfd0-94768045da8f tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:53.507981 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b2337f0d-6d13-4a12-bfd0-94768045da8f tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:53.508445 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b2337f0d-6d13-4a12-bfd0-94768045da8f tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:53.509136 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b2337f0d-6d13-4a12-bfd0-94768045da8f tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:53.509592 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b2337f0d-6d13-4a12-bfd0-94768045da8f tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:53.510015 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b2337f0d-6d13-4a12-bfd0-94768045da8f tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:53.664236 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-b2337f0d-6d13-4a12-bfd0-94768045da8f tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:53.675585 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b2337f0d-6d13-4a12-bfd0-94768045da8f tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1315 microversion: 2.1 time: 0.176667 Sep 07 15:56:53.676334 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 78/159] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:53 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:53.875498 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-df989836-9433-41c3-9676-db464e20ae3a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:53.876167 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-df989836-9433-41c3-9676-db464e20ae3a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:53.882000 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df989836-9433-41c3-9676-db464e20ae3a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:53.882481 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df989836-9433-41c3-9676-db464e20ae3a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:53.882906 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df989836-9433-41c3-9676-db464e20ae3a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:53.883631 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df989836-9433-41c3-9676-db464e20ae3a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:53.884102 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df989836-9433-41c3-9676-db464e20ae3a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:53.884522 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df989836-9433-41c3-9676-db464e20ae3a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:54.037407 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-df989836-9433-41c3-9676-db464e20ae3a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:54.047468 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-df989836-9433-41c3-9676-db464e20ae3a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1322 microversion: 2.1 time: 0.175828 Sep 07 15:56:54.048277 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 82/160] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:53 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:54.101943 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-99881b66-8465-4ee9-8900-1917087e01e7 req-e8aa97ad-b642-49b0-88cc-1e7aadc25a47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "331c4dfb-7ee1-4585-bed9-2e65fa1f062a", "name": "network-vif-plugged", "status": "completed", "tag": "dcda231d-d2f5-41dc-b0c3-658f97c33345"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:56:54.112009 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-99881b66-8465-4ee9-8900-1917087e01e7 req-e8aa97ad-b642-49b0-88cc-1e7aadc25a47 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:54.112843 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-99881b66-8465-4ee9-8900-1917087e01e7 req-e8aa97ad-b642-49b0-88cc-1e7aadc25a47 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:54.113593 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-99881b66-8465-4ee9-8900-1917087e01e7 req-e8aa97ad-b642-49b0-88cc-1e7aadc25a47 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:54.128586 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-99881b66-8465-4ee9-8900-1917087e01e7 req-e8aa97ad-b642-49b0-88cc-1e7aadc25a47 service nova] Creating event network-vif-plugged:dcda231d-d2f5-41dc-b0c3-658f97c33345 for instance 331c4dfb-7ee1-4585-bed9-2e65fa1f062a on hv-cinder-85331 Sep 07 15:56:54.133747 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-99881b66-8465-4ee9-8900-1917087e01e7 req-e8aa97ad-b642-49b0-88cc-1e7aadc25a47 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036294 Sep 07 15:56:54.134352 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 79/161] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 15:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:56:54.511380 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-97a6a375-bfcc-4e1f-a7fb-dd23e76f1f64 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:54.511973 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-97a6a375-bfcc-4e1f-a7fb-dd23e76f1f64 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:54.518445 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97a6a375-bfcc-4e1f-a7fb-dd23e76f1f64 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:54.518925 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97a6a375-bfcc-4e1f-a7fb-dd23e76f1f64 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:54.519356 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97a6a375-bfcc-4e1f-a7fb-dd23e76f1f64 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:54.520115 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97a6a375-bfcc-4e1f-a7fb-dd23e76f1f64 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:54.520506 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97a6a375-bfcc-4e1f-a7fb-dd23e76f1f64 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:54.520923 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97a6a375-bfcc-4e1f-a7fb-dd23e76f1f64 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:54.647834 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-97a6a375-bfcc-4e1f-a7fb-dd23e76f1f64 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:54.658111 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-97a6a375-bfcc-4e1f-a7fb-dd23e76f1f64 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:54.659669 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-97a6a375-bfcc-4e1f-a7fb-dd23e76f1f64 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:54.660826 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-97a6a375-bfcc-4e1f-a7fb-dd23e76f1f64 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1406 microversion: 2.20 time: 0.153461 Sep 07 15:56:54.661385 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 83/162] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:56:54 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:56:54.701176 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-56702aee-c0c6-423d-9e9f-393453aed230 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:54.701869 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-56702aee-c0c6-423d-9e9f-393453aed230 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:54.708837 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-56702aee-c0c6-423d-9e9f-393453aed230 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:54.709318 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-56702aee-c0c6-423d-9e9f-393453aed230 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:54.709745 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-56702aee-c0c6-423d-9e9f-393453aed230 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:54.710429 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-56702aee-c0c6-423d-9e9f-393453aed230 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:54.710875 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-56702aee-c0c6-423d-9e9f-393453aed230 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:54.711297 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-56702aee-c0c6-423d-9e9f-393453aed230 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:54.715378 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=100 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:54.851647 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-56702aee-c0c6-423d-9e9f-393453aed230 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:54.860133 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-56702aee-c0c6-423d-9e9f-393453aed230 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1315 microversion: 2.1 time: 0.163223 Sep 07 15:56:54.860723 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 80/163] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:54 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:55.070922 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-95f5cd3f-bb2b-4a3e-acde-514166867b4a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:55.071665 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-95f5cd3f-bb2b-4a3e-acde-514166867b4a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:55.077492 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-95f5cd3f-bb2b-4a3e-acde-514166867b4a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:55.077950 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-95f5cd3f-bb2b-4a3e-acde-514166867b4a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:55.078380 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-95f5cd3f-bb2b-4a3e-acde-514166867b4a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:55.079055 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-95f5cd3f-bb2b-4a3e-acde-514166867b4a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:55.079504 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-95f5cd3f-bb2b-4a3e-acde-514166867b4a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:55.079973 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-95f5cd3f-bb2b-4a3e-acde-514166867b4a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:55.208740 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-95f5cd3f-bb2b-4a3e-acde-514166867b4a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:55.216972 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-95f5cd3f-bb2b-4a3e-acde-514166867b4a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1322 microversion: 2.1 time: 0.149788 Sep 07 15:56:55.217680 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 84/164] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:55 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:55.686666 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-766f7e57-eca8-4a98-ac33-015fe69f5cc1 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:55.687351 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-766f7e57-eca8-4a98-ac33-015fe69f5cc1 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:55.695920 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-766f7e57-eca8-4a98-ac33-015fe69f5cc1 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:55.696538 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-766f7e57-eca8-4a98-ac33-015fe69f5cc1 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:55.696969 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-766f7e57-eca8-4a98-ac33-015fe69f5cc1 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:55.697726 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-766f7e57-eca8-4a98-ac33-015fe69f5cc1 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:55.698171 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-766f7e57-eca8-4a98-ac33-015fe69f5cc1 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:55.698652 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-766f7e57-eca8-4a98-ac33-015fe69f5cc1 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:55.835805 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-766f7e57-eca8-4a98-ac33-015fe69f5cc1 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:55.844184 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-766f7e57-eca8-4a98-ac33-015fe69f5cc1 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:55.845750 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-766f7e57-eca8-4a98-ac33-015fe69f5cc1 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:55.846849 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-766f7e57-eca8-4a98-ac33-015fe69f5cc1 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1406 microversion: 2.20 time: 0.164040 Sep 07 15:56:55.847771 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 81/165] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:56:55 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:56:55.882757 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a8271888-1dbf-4f2c-9fd3-de99e8645948 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:55.883321 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a8271888-1dbf-4f2c-9fd3-de99e8645948 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:55.889558 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8271888-1dbf-4f2c-9fd3-de99e8645948 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:55.890142 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8271888-1dbf-4f2c-9fd3-de99e8645948 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:55.890542 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8271888-1dbf-4f2c-9fd3-de99e8645948 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:55.891305 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8271888-1dbf-4f2c-9fd3-de99e8645948 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:55.891783 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8271888-1dbf-4f2c-9fd3-de99e8645948 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:55.892258 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a8271888-1dbf-4f2c-9fd3-de99e8645948 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:56.087067 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a8271888-1dbf-4f2c-9fd3-de99e8645948 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:56.110080 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a8271888-1dbf-4f2c-9fd3-de99e8645948 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1315 microversion: 2.1 time: 0.231125 Sep 07 15:56:56.110660 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 85/166] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:55 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:56.243277 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-70a067a9-ad38-45d2-9574-bfad62ca5756 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:56.243978 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-70a067a9-ad38-45d2-9574-bfad62ca5756 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:56.269209 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70a067a9-ad38-45d2-9574-bfad62ca5756 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:56.269777 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70a067a9-ad38-45d2-9574-bfad62ca5756 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:56.270413 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70a067a9-ad38-45d2-9574-bfad62ca5756 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:56.271178 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70a067a9-ad38-45d2-9574-bfad62ca5756 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:56.271785 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70a067a9-ad38-45d2-9574-bfad62ca5756 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:56.277414 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70a067a9-ad38-45d2-9574-bfad62ca5756 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:56.437996 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-70a067a9-ad38-45d2-9574-bfad62ca5756 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:56.445615 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-70a067a9-ad38-45d2-9574-bfad62ca5756 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1322 microversion: 2.1 time: 0.207858 Sep 07 15:56:56.446173 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 82/167] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:56 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:56.901727 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d8711527-7cf5-435e-a671-981f2ce7d3e0 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:56.901727 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d8711527-7cf5-435e-a671-981f2ce7d3e0 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:56.910569 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8711527-7cf5-435e-a671-981f2ce7d3e0 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:56.910569 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8711527-7cf5-435e-a671-981f2ce7d3e0 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:56.910569 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8711527-7cf5-435e-a671-981f2ce7d3e0 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:56.910569 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8711527-7cf5-435e-a671-981f2ce7d3e0 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:56.910886 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8711527-7cf5-435e-a671-981f2ce7d3e0 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:56.910886 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8711527-7cf5-435e-a671-981f2ce7d3e0 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:57.100341 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d8711527-7cf5-435e-a671-981f2ce7d3e0 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:57.111903 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d8711527-7cf5-435e-a671-981f2ce7d3e0 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:57.114041 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d8711527-7cf5-435e-a671-981f2ce7d3e0 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:57.115450 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d8711527-7cf5-435e-a671-981f2ce7d3e0 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1406 microversion: 2.20 time: 0.245966 Sep 07 15:56:57.135257 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 86/168] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:56:56 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1406 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:56:57.142805 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7c267746-4698-4e22-b6e8-3b2173eaa8da tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:57.143429 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7c267746-4698-4e22-b6e8-3b2173eaa8da tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:57.153064 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c267746-4698-4e22-b6e8-3b2173eaa8da tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:57.156386 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c267746-4698-4e22-b6e8-3b2173eaa8da tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:57.156964 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c267746-4698-4e22-b6e8-3b2173eaa8da tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:57.157932 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c267746-4698-4e22-b6e8-3b2173eaa8da tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:57.158515 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c267746-4698-4e22-b6e8-3b2173eaa8da tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:57.159229 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c267746-4698-4e22-b6e8-3b2173eaa8da tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:57.323426 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-7c267746-4698-4e22-b6e8-3b2173eaa8da tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:57.331890 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7c267746-4698-4e22-b6e8-3b2173eaa8da tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1315 microversion: 2.1 time: 0.198629 Sep 07 15:56:57.332465 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 83/169] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:57 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:56:57.468588 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e7c57917-e192-42f6-9fbe-82538c9a8802 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:57.469192 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e7c57917-e192-42f6-9fbe-82538c9a8802 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:57.476042 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7c57917-e192-42f6-9fbe-82538c9a8802 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:57.476776 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7c57917-e192-42f6-9fbe-82538c9a8802 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:57.477746 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7c57917-e192-42f6-9fbe-82538c9a8802 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:57.478883 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7c57917-e192-42f6-9fbe-82538c9a8802 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:57.479411 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7c57917-e192-42f6-9fbe-82538c9a8802 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:57.480233 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7c57917-e192-42f6-9fbe-82538c9a8802 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:57.630338 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e7c57917-e192-42f6-9fbe-82538c9a8802 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:57.642114 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e7c57917-e192-42f6-9fbe-82538c9a8802 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1322 microversion: 2.1 time: 0.177176 Sep 07 15:56:57.642637 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 87/170] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:57 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:58.150728 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a62f858e-7bed-4b3e-b66a-aadb5de6d38e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:58.154844 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a62f858e-7bed-4b3e-b66a-aadb5de6d38e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:58.180835 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a62f858e-7bed-4b3e-b66a-aadb5de6d38e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:58.181346 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a62f858e-7bed-4b3e-b66a-aadb5de6d38e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:58.185223 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a62f858e-7bed-4b3e-b66a-aadb5de6d38e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:58.190471 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a62f858e-7bed-4b3e-b66a-aadb5de6d38e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:58.191212 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a62f858e-7bed-4b3e-b66a-aadb5de6d38e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:58.194591 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a62f858e-7bed-4b3e-b66a-aadb5de6d38e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:58.357622 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f5f2cecf-4aa8-497d-b1d5-8aac00d853cd tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:58.358502 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f5f2cecf-4aa8-497d-b1d5-8aac00d853cd tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:58.374416 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5f2cecf-4aa8-497d-b1d5-8aac00d853cd tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:58.375242 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5f2cecf-4aa8-497d-b1d5-8aac00d853cd tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:58.375877 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5f2cecf-4aa8-497d-b1d5-8aac00d853cd tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:58.377245 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5f2cecf-4aa8-497d-b1d5-8aac00d853cd tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:58.378640 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5f2cecf-4aa8-497d-b1d5-8aac00d853cd tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:58.379162 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f5f2cecf-4aa8-497d-b1d5-8aac00d853cd tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:58.555820 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-a62f858e-7bed-4b3e-b66a-aadb5de6d38e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:58.570629 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-a62f858e-7bed-4b3e-b66a-aadb5de6d38e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:58.579938 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-a62f858e-7bed-4b3e-b66a-aadb5de6d38e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:58.589970 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a62f858e-7bed-4b3e-b66a-aadb5de6d38e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1406 microversion: 2.20 time: 0.448699 Sep 07 15:56:58.600405 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 84/171] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:56:58 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1406 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:56:58.664971 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7175144a-0903-4f39-a2d7-27fcc359e93c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:58.666089 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7175144a-0903-4f39-a2d7-27fcc359e93c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:58.694350 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7175144a-0903-4f39-a2d7-27fcc359e93c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:58.696645 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7175144a-0903-4f39-a2d7-27fcc359e93c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:58.698901 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7175144a-0903-4f39-a2d7-27fcc359e93c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:58.699828 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7175144a-0903-4f39-a2d7-27fcc359e93c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:58.703469 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7175144a-0903-4f39-a2d7-27fcc359e93c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:58.708103 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7175144a-0903-4f39-a2d7-27fcc359e93c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:58.971413 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f5f2cecf-4aa8-497d-b1d5-8aac00d853cd tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:58.982901 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f5f2cecf-4aa8-497d-b1d5-8aac00d853cd tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1315 microversion: 2.1 time: 0.630598 Sep 07 15:56:58.983496 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 88/172] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:58 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1315 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:58.998489 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-a6ffac9c-f75e-4911-8e84-4df2eb5331a1 req-89d574c0-9298-4b20-8a71-9ba848b03559 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "546eacb2-a6cd-44c7-8abf-97798497d947", "name": "network-vif-plugged", "status": "completed", "tag": "aa591f91-fdf7-4476-bfea-32a7fbad414b"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:56:59.011137 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a6ffac9c-f75e-4911-8e84-4df2eb5331a1 req-89d574c0-9298-4b20-8a71-9ba848b03559 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:59.012287 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a6ffac9c-f75e-4911-8e84-4df2eb5331a1 req-89d574c0-9298-4b20-8a71-9ba848b03559 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:59.012888 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a6ffac9c-f75e-4911-8e84-4df2eb5331a1 req-89d574c0-9298-4b20-8a71-9ba848b03559 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:59.027773 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-a6ffac9c-f75e-4911-8e84-4df2eb5331a1 req-89d574c0-9298-4b20-8a71-9ba848b03559 service nova] Creating event network-vif-plugged:aa591f91-fdf7-4476-bfea-32a7fbad414b for instance 546eacb2-a6cd-44c7-8abf-97798497d947 on hv-cinder-85331 Sep 07 15:56:59.042643 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-a6ffac9c-f75e-4911-8e84-4df2eb5331a1 req-89d574c0-9298-4b20-8a71-9ba848b03559 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057897 Sep 07 15:56:59.043497 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 89/173] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 15:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:56:59.191185 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-7175144a-0903-4f39-a2d7-27fcc359e93c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:59.201496 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7175144a-0903-4f39-a2d7-27fcc359e93c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1322 microversion: 2.1 time: 0.540273 Sep 07 15:56:59.217068 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 85/174] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:56:58 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1322 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:56:59.632866 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-eb3c662e-ea57-434f-a62d-c8fd3cb9f3da tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:56:59.636043 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-eb3c662e-ea57-434f-a62d-c8fd3cb9f3da tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:56:59.647912 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb3c662e-ea57-434f-a62d-c8fd3cb9f3da tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:59.649009 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb3c662e-ea57-434f-a62d-c8fd3cb9f3da tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:59.649947 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb3c662e-ea57-434f-a62d-c8fd3cb9f3da tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:59.651818 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb3c662e-ea57-434f-a62d-c8fd3cb9f3da tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:56:59.652596 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb3c662e-ea57-434f-a62d-c8fd3cb9f3da tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:56:59.653310 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb3c662e-ea57-434f-a62d-c8fd3cb9f3da tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:56:59.918529 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-eb3c662e-ea57-434f-a62d-c8fd3cb9f3da tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:59.929111 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-eb3c662e-ea57-434f-a62d-c8fd3cb9f3da tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:59.930784 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-eb3c662e-ea57-434f-a62d-c8fd3cb9f3da tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:56:59.932565 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-eb3c662e-ea57-434f-a62d-c8fd3cb9f3da tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1406 microversion: 2.20 time: 0.307589 Sep 07 15:56:59.948030 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 90/175] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:56:59 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1406 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:57:00.011790 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d2588aa3-7e2d-41a1-934a-f3a8d1a77981 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:00.013319 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d2588aa3-7e2d-41a1-934a-f3a8d1a77981 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:00.019104 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=74 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:00.028758 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2588aa3-7e2d-41a1-934a-f3a8d1a77981 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:00.029573 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2588aa3-7e2d-41a1-934a-f3a8d1a77981 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:00.030819 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2588aa3-7e2d-41a1-934a-f3a8d1a77981 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:00.032202 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2588aa3-7e2d-41a1-934a-f3a8d1a77981 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:00.033795 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2588aa3-7e2d-41a1-934a-f3a8d1a77981 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:00.034864 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2588aa3-7e2d-41a1-934a-f3a8d1a77981 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:00.226424 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8ae331c2-df22-493c-a1f8-9d91b08108c5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:00.227206 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8ae331c2-df22-493c-a1f8-9d91b08108c5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:00.233646 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ae331c2-df22-493c-a1f8-9d91b08108c5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:00.234461 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ae331c2-df22-493c-a1f8-9d91b08108c5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:00.235177 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ae331c2-df22-493c-a1f8-9d91b08108c5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:00.237130 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ae331c2-df22-493c-a1f8-9d91b08108c5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:00.237578 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ae331c2-df22-493c-a1f8-9d91b08108c5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:00.238163 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ae331c2-df22-493c-a1f8-9d91b08108c5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:00.291081 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-d2588aa3-7e2d-41a1-934a-f3a8d1a77981 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:00.303801 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d2588aa3-7e2d-41a1-934a-f3a8d1a77981 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1315 microversion: 2.1 time: 0.299055 Sep 07 15:57:00.304760 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 86/176] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:00 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:00.475299 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-8ae331c2-df22-493c-a1f8-9d91b08108c5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:00.484579 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8ae331c2-df22-493c-a1f8-9d91b08108c5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1322 microversion: 2.1 time: 0.262745 Sep 07 15:57:00.485314 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 91/177] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:00 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1322 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:00.961948 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b1b1adbb-904d-496b-90db-9890951d5605 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:00.962766 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b1b1adbb-904d-496b-90db-9890951d5605 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:00.973590 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b1b1adbb-904d-496b-90db-9890951d5605 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:00.974608 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b1b1adbb-904d-496b-90db-9890951d5605 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:00.975359 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b1b1adbb-904d-496b-90db-9890951d5605 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:00.977198 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b1b1adbb-904d-496b-90db-9890951d5605 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:00.977862 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b1b1adbb-904d-496b-90db-9890951d5605 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:00.978526 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b1b1adbb-904d-496b-90db-9890951d5605 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:01.057785 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-8c1cf0d4-59ee-475b-9b38-af9004becb07 req-bfe4f665-fda2-49d8-9d83-78529c190796 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f39427e6-62a5-4a4e-96e8-644f03653722", "name": "network-vif-plugged", "status": "completed", "tag": "c1b41643-a122-48be-8241-42826288f60e"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:57:01.067450 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-8c1cf0d4-59ee-475b-9b38-af9004becb07 req-bfe4f665-fda2-49d8-9d83-78529c190796 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:01.067953 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-8c1cf0d4-59ee-475b-9b38-af9004becb07 req-bfe4f665-fda2-49d8-9d83-78529c190796 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:01.068377 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-8c1cf0d4-59ee-475b-9b38-af9004becb07 req-bfe4f665-fda2-49d8-9d83-78529c190796 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:01.080286 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-8c1cf0d4-59ee-475b-9b38-af9004becb07 req-bfe4f665-fda2-49d8-9d83-78529c190796 service nova] Creating event network-vif-plugged:c1b41643-a122-48be-8241-42826288f60e for instance f39427e6-62a5-4a4e-96e8-644f03653722 on hv-cinder-85331 Sep 07 15:57:01.085335 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-8c1cf0d4-59ee-475b-9b38-af9004becb07 req-bfe4f665-fda2-49d8-9d83-78529c190796 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031063 Sep 07 15:57:01.085922 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 92/178] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 15:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 15:57:01.227748 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-b1b1adbb-904d-496b-90db-9890951d5605 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:01.236350 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-b1b1adbb-904d-496b-90db-9890951d5605 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:01.237765 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-b1b1adbb-904d-496b-90db-9890951d5605 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:01.238864 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b1b1adbb-904d-496b-90db-9890951d5605 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1406 microversion: 2.20 time: 0.281490 Sep 07 15:57:01.239427 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 87/179] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:57:00 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1406 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:57:01.331027 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-26cd393a-7200-40e3-86e6-1de4f7997865 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:01.331982 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-26cd393a-7200-40e3-86e6-1de4f7997865 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:01.338393 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26cd393a-7200-40e3-86e6-1de4f7997865 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:01.339105 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26cd393a-7200-40e3-86e6-1de4f7997865 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:01.339734 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26cd393a-7200-40e3-86e6-1de4f7997865 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:01.340599 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26cd393a-7200-40e3-86e6-1de4f7997865 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:01.341048 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26cd393a-7200-40e3-86e6-1de4f7997865 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:01.341465 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26cd393a-7200-40e3-86e6-1de4f7997865 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:01.508383 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f084cf07-c72f-4f60-ae5a-f0e42ee2f315 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:01.508994 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f084cf07-c72f-4f60-ae5a-f0e42ee2f315 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:01.515345 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f084cf07-c72f-4f60-ae5a-f0e42ee2f315 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:01.515875 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f084cf07-c72f-4f60-ae5a-f0e42ee2f315 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:01.516303 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f084cf07-c72f-4f60-ae5a-f0e42ee2f315 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:01.517504 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f084cf07-c72f-4f60-ae5a-f0e42ee2f315 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:01.518151 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f084cf07-c72f-4f60-ae5a-f0e42ee2f315 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:01.518726 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f084cf07-c72f-4f60-ae5a-f0e42ee2f315 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:01.557231 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-26cd393a-7200-40e3-86e6-1de4f7997865 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:01.568912 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-26cd393a-7200-40e3-86e6-1de4f7997865 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1315 microversion: 2.1 time: 0.243538 Sep 07 15:57:01.569818 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 93/180] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:01 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:01.670434 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-f084cf07-c72f-4f60-ae5a-f0e42ee2f315 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:01.678760 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f084cf07-c72f-4f60-ae5a-f0e42ee2f315 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1322 microversion: 2.1 time: 0.174370 Sep 07 15:57:01.687906 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 88/181] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:01 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:02.266509 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7b78905d-0891-40cc-ba69-ead9117def38 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:02.268323 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7b78905d-0891-40cc-ba69-ead9117def38 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:02.271147 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=80 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:02.277567 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b78905d-0891-40cc-ba69-ead9117def38 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:02.278530 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b78905d-0891-40cc-ba69-ead9117def38 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:02.279096 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b78905d-0891-40cc-ba69-ead9117def38 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:02.279941 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b78905d-0891-40cc-ba69-ead9117def38 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:02.280728 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b78905d-0891-40cc-ba69-ead9117def38 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:02.281004 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7b78905d-0891-40cc-ba69-ead9117def38 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:02.425999 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7b78905d-0891-40cc-ba69-ead9117def38 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:02.434649 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7b78905d-0891-40cc-ba69-ead9117def38 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:02.436112 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7b78905d-0891-40cc-ba69-ead9117def38 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:02.437237 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7b78905d-0891-40cc-ba69-ead9117def38 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1406 microversion: 2.20 time: 0.175338 Sep 07 15:57:02.437770 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 94/182] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:57:02 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:57:02.596924 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e0ea00ab-de3e-4077-b279-b37f3a4d34e2 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:02.597558 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e0ea00ab-de3e-4077-b279-b37f3a4d34e2 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:02.604133 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e0ea00ab-de3e-4077-b279-b37f3a4d34e2 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:02.604612 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e0ea00ab-de3e-4077-b279-b37f3a4d34e2 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:02.605035 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e0ea00ab-de3e-4077-b279-b37f3a4d34e2 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:02.605877 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e0ea00ab-de3e-4077-b279-b37f3a4d34e2 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:02.606477 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e0ea00ab-de3e-4077-b279-b37f3a4d34e2 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:02.606894 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e0ea00ab-de3e-4077-b279-b37f3a4d34e2 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:02.703751 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-986bbf57-f298-4b8c-b8ac-594288bf409c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:02.705152 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-986bbf57-f298-4b8c-b8ac-594288bf409c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:02.711211 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-986bbf57-f298-4b8c-b8ac-594288bf409c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:02.711927 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-986bbf57-f298-4b8c-b8ac-594288bf409c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:02.712366 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-986bbf57-f298-4b8c-b8ac-594288bf409c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:02.713100 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-986bbf57-f298-4b8c-b8ac-594288bf409c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:02.713495 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-986bbf57-f298-4b8c-b8ac-594288bf409c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:02.714147 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-986bbf57-f298-4b8c-b8ac-594288bf409c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:02.859737 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-e0ea00ab-de3e-4077-b279-b37f3a4d34e2 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:02.872543 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e0ea00ab-de3e-4077-b279-b37f3a4d34e2 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1315 microversion: 2.1 time: 0.279893 Sep 07 15:57:02.873781 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 89/183] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:02 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:02.875955 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-986bbf57-f298-4b8c-b8ac-594288bf409c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:02.885032 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-986bbf57-f298-4b8c-b8ac-594288bf409c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1322 microversion: 2.1 time: 0.185267 Sep 07 15:57:02.885968 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 95/184] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:02 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:57:03.462024 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e50c28f6-4c66-4e6c-87b4-2ef5fc2184db tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:03.462639 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e50c28f6-4c66-4e6c-87b4-2ef5fc2184db tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:03.468513 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e50c28f6-4c66-4e6c-87b4-2ef5fc2184db tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:03.468997 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e50c28f6-4c66-4e6c-87b4-2ef5fc2184db tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:03.469431 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e50c28f6-4c66-4e6c-87b4-2ef5fc2184db tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:03.470146 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e50c28f6-4c66-4e6c-87b4-2ef5fc2184db tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:03.470601 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e50c28f6-4c66-4e6c-87b4-2ef5fc2184db tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:03.471025 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e50c28f6-4c66-4e6c-87b4-2ef5fc2184db tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:03.612682 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-e50c28f6-4c66-4e6c-87b4-2ef5fc2184db tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:03.621075 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-e50c28f6-4c66-4e6c-87b4-2ef5fc2184db tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:03.622813 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-e50c28f6-4c66-4e6c-87b4-2ef5fc2184db tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:03.624190 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e50c28f6-4c66-4e6c-87b4-2ef5fc2184db tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1406 microversion: 2.20 time: 0.166224 Sep 07 15:57:03.624854 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 90/185] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:57:03 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:57:03.899400 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3bcdf19b-0fae-48de-9c73-64031d854683 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:03.900594 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3bcdf19b-0fae-48de-9c73-64031d854683 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:03.907288 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bcdf19b-0fae-48de-9c73-64031d854683 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:03.908514 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bcdf19b-0fae-48de-9c73-64031d854683 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:03.909319 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bcdf19b-0fae-48de-9c73-64031d854683 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:03.910190 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bcdf19b-0fae-48de-9c73-64031d854683 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:03.910806 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bcdf19b-0fae-48de-9c73-64031d854683 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:03.911213 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-785ee35c-960e-44af-b957-af091c7d8209 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:03.911382 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3bcdf19b-0fae-48de-9c73-64031d854683 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:03.911867 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-785ee35c-960e-44af-b957-af091c7d8209 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:03.918418 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-785ee35c-960e-44af-b957-af091c7d8209 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:03.918900 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-785ee35c-960e-44af-b957-af091c7d8209 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:03.919335 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-785ee35c-960e-44af-b957-af091c7d8209 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:03.920074 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-785ee35c-960e-44af-b957-af091c7d8209 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:03.920532 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-785ee35c-960e-44af-b957-af091c7d8209 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:03.920955 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-785ee35c-960e-44af-b957-af091c7d8209 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:03.933144 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:04.091966 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3bcdf19b-0fae-48de-9c73-64031d854683 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:04.100448 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3bcdf19b-0fae-48de-9c73-64031d854683 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1315 microversion: 2.1 time: 0.205730 Sep 07 15:57:04.101612 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 96/186] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:03 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:04.134921 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-785ee35c-960e-44af-b957-af091c7d8209 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:04.143067 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-785ee35c-960e-44af-b957-af091c7d8209 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1322 microversion: 2.1 time: 0.236183 Sep 07 15:57:04.143956 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 91/187] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:03 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:57:04.649107 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-68bdd7b1-937f-454b-890f-5ea6ce479999 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:04.649715 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-68bdd7b1-937f-454b-890f-5ea6ce479999 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:04.655491 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-68bdd7b1-937f-454b-890f-5ea6ce479999 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:04.656023 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-68bdd7b1-937f-454b-890f-5ea6ce479999 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:04.656446 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-68bdd7b1-937f-454b-890f-5ea6ce479999 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:04.657126 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-68bdd7b1-937f-454b-890f-5ea6ce479999 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:04.657602 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-68bdd7b1-937f-454b-890f-5ea6ce479999 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:04.658026 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-68bdd7b1-937f-454b-890f-5ea6ce479999 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:04.792710 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-68bdd7b1-937f-454b-890f-5ea6ce479999 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:04.801561 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-68bdd7b1-937f-454b-890f-5ea6ce479999 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:04.803080 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-68bdd7b1-937f-454b-890f-5ea6ce479999 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:04.804285 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-68bdd7b1-937f-454b-890f-5ea6ce479999 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1406 microversion: 2.20 time: 0.159110 Sep 07 15:57:04.804829 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 97/188] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:57:04 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:57:05.125469 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d8effa5a-3027-4fb6-9c13-d769337bb271 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:05.126016 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d8effa5a-3027-4fb6-9c13-d769337bb271 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:05.143720 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d8effa5a-3027-4fb6-9c13-d769337bb271 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:05.144215 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d8effa5a-3027-4fb6-9c13-d769337bb271 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:05.144666 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d8effa5a-3027-4fb6-9c13-d769337bb271 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:05.145381 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d8effa5a-3027-4fb6-9c13-d769337bb271 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:05.145832 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d8effa5a-3027-4fb6-9c13-d769337bb271 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:05.146287 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d8effa5a-3027-4fb6-9c13-d769337bb271 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:05.167361 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fb66f617-6940-4072-bfa1-8e31b86d9fdf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:05.168277 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fb66f617-6940-4072-bfa1-8e31b86d9fdf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:05.176012 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb66f617-6940-4072-bfa1-8e31b86d9fdf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:05.176616 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb66f617-6940-4072-bfa1-8e31b86d9fdf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:05.177202 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb66f617-6940-4072-bfa1-8e31b86d9fdf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:05.177991 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb66f617-6940-4072-bfa1-8e31b86d9fdf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:05.178563 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb66f617-6940-4072-bfa1-8e31b86d9fdf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:05.179447 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fb66f617-6940-4072-bfa1-8e31b86d9fdf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:05.286325 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-d8effa5a-3027-4fb6-9c13-d769337bb271 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:05.296036 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d8effa5a-3027-4fb6-9c13-d769337bb271 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1502 microversion: 2.1 time: 0.174336 Sep 07 15:57:05.296696 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 92/189] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:05 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1502 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:05.327411 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-fb66f617-6940-4072-bfa1-8e31b86d9fdf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:05.337163 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fb66f617-6940-4072-bfa1-8e31b86d9fdf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1322 microversion: 2.1 time: 0.175220 Sep 07 15:57:05.339612 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 98/190] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:05 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:57:05.829012 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-023772fa-e626-4f97-844d-6175fffe6193 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:05.830350 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-023772fa-e626-4f97-844d-6175fffe6193 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:05.836388 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-023772fa-e626-4f97-844d-6175fffe6193 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:05.836867 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-023772fa-e626-4f97-844d-6175fffe6193 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:05.837294 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-023772fa-e626-4f97-844d-6175fffe6193 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:05.837965 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-023772fa-e626-4f97-844d-6175fffe6193 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:05.838411 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-023772fa-e626-4f97-844d-6175fffe6193 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:05.838818 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-023772fa-e626-4f97-844d-6175fffe6193 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:05.969104 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-023772fa-e626-4f97-844d-6175fffe6193 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:05.977459 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-023772fa-e626-4f97-844d-6175fffe6193 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:05.979086 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-023772fa-e626-4f97-844d-6175fffe6193 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:05.980174 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-023772fa-e626-4f97-844d-6175fffe6193 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1406 microversion: 2.20 time: 0.155209 Sep 07 15:57:05.980724 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 93/191] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:57:05 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:57:06.361813 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-71d3c0cc-f056-4e1e-a92a-b0a239e4af20 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:06.362367 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-71d3c0cc-f056-4e1e-a92a-b0a239e4af20 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:06.368156 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71d3c0cc-f056-4e1e-a92a-b0a239e4af20 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:06.368634 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71d3c0cc-f056-4e1e-a92a-b0a239e4af20 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:06.369063 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71d3c0cc-f056-4e1e-a92a-b0a239e4af20 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:06.369743 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71d3c0cc-f056-4e1e-a92a-b0a239e4af20 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:06.370188 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71d3c0cc-f056-4e1e-a92a-b0a239e4af20 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:06.370606 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71d3c0cc-f056-4e1e-a92a-b0a239e4af20 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:06.508099 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-71d3c0cc-f056-4e1e-a92a-b0a239e4af20 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:06.516412 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-71d3c0cc-f056-4e1e-a92a-b0a239e4af20 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1322 microversion: 2.1 time: 0.159377 Sep 07 15:57:06.517090 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 99/192] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:06 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:07.005922 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cfa64242-ead6-4f23-8d15-4976368e7658 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:07.006515 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cfa64242-ead6-4f23-8d15-4976368e7658 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:07.014500 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cfa64242-ead6-4f23-8d15-4976368e7658 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:07.014980 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cfa64242-ead6-4f23-8d15-4976368e7658 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:07.015433 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cfa64242-ead6-4f23-8d15-4976368e7658 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:07.016325 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cfa64242-ead6-4f23-8d15-4976368e7658 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:07.016813 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cfa64242-ead6-4f23-8d15-4976368e7658 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:07.017319 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cfa64242-ead6-4f23-8d15-4976368e7658 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:07.161276 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-cfa64242-ead6-4f23-8d15-4976368e7658 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:07.171509 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-cfa64242-ead6-4f23-8d15-4976368e7658 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:07.173830 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-cfa64242-ead6-4f23-8d15-4976368e7658 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:07.174943 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cfa64242-ead6-4f23-8d15-4976368e7658 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1406 microversion: 2.20 time: 0.173495 Sep 07 15:57:07.175493 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 94/193] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:57:07 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:57:07.540722 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-79fc1a3f-1402-4115-9de6-2d3afbe8c990 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:07.541502 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-79fc1a3f-1402-4115-9de6-2d3afbe8c990 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:07.547597 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-79fc1a3f-1402-4115-9de6-2d3afbe8c990 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:07.548794 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-79fc1a3f-1402-4115-9de6-2d3afbe8c990 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:07.549227 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-79fc1a3f-1402-4115-9de6-2d3afbe8c990 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:07.549914 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-79fc1a3f-1402-4115-9de6-2d3afbe8c990 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:07.550435 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-79fc1a3f-1402-4115-9de6-2d3afbe8c990 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:07.550781 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-79fc1a3f-1402-4115-9de6-2d3afbe8c990 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:07.689689 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-79fc1a3f-1402-4115-9de6-2d3afbe8c990 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:07.698471 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-79fc1a3f-1402-4115-9de6-2d3afbe8c990 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1322 microversion: 2.1 time: 0.161521 Sep 07 15:57:07.699137 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 100/194] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:07 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:07.773144 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-da89fe23-7a39-47ee-9cd6-2a01edb35dfd tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eedc10c2-8a7c-4ade-9f40-43b8c9c1dc2a"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:57:07.775472 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-da89fe23-7a39-47ee-9cd6-2a01edb35dfd tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:07.782414 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-da89fe23-7a39-47ee-9cd6-2a01edb35dfd tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:07.783013 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-da89fe23-7a39-47ee-9cd6-2a01edb35dfd tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:07.783567 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-da89fe23-7a39-47ee-9cd6-2a01edb35dfd tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:07.784316 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-da89fe23-7a39-47ee-9cd6-2a01edb35dfd tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:07.784840 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-da89fe23-7a39-47ee-9cd6-2a01edb35dfd tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:07.785341 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-da89fe23-7a39-47ee-9cd6-2a01edb35dfd tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:08.201517 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b6a6ae26-1e7f-414f-be84-60beda7ef83c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:08.202325 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b6a6ae26-1e7f-414f-be84-60beda7ef83c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:08.209241 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6a6ae26-1e7f-414f-be84-60beda7ef83c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:08.209907 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6a6ae26-1e7f-414f-be84-60beda7ef83c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:08.210495 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6a6ae26-1e7f-414f-be84-60beda7ef83c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:08.211190 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6a6ae26-1e7f-414f-be84-60beda7ef83c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:08.211671 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6a6ae26-1e7f-414f-be84-60beda7ef83c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:08.212098 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6a6ae26-1e7f-414f-be84-60beda7ef83c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:08.398858 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b6a6ae26-1e7f-414f-be84-60beda7ef83c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:08.409931 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b6a6ae26-1e7f-414f-be84-60beda7ef83c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:08.411890 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b6a6ae26-1e7f-414f-be84-60beda7ef83c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:08.413408 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b6a6ae26-1e7f-414f-be84-60beda7ef83c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1598 microversion: 2.20 time: 0.215692 Sep 07 15:57:08.414118 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 101/195] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:57:08 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1598 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 15:57:08.440877 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f7480370-bf66-4fe0-a4e1-06689c5caed2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:08.441564 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f7480370-bf66-4fe0-a4e1-06689c5caed2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:08.449301 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7480370-bf66-4fe0-a4e1-06689c5caed2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:08.449826 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7480370-bf66-4fe0-a4e1-06689c5caed2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:08.450266 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7480370-bf66-4fe0-a4e1-06689c5caed2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:08.451176 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7480370-bf66-4fe0-a4e1-06689c5caed2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:08.451658 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7480370-bf66-4fe0-a4e1-06689c5caed2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:08.452086 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f7480370-bf66-4fe0-a4e1-06689c5caed2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:08.581471 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f7480370-bf66-4fe0-a4e1-06689c5caed2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.144526 Sep 07 15:57:08.589489 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 102/196] 10.222.0.17 () {60 vars in 1316 bytes} [Wed Sep 7 15:57:08 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a/os-interface => generated 284 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 15:57:08.730367 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ae72be39-ed8b-4002-b8e4-a4654f859b7f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:08.731381 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ae72be39-ed8b-4002-b8e4-a4654f859b7f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:08.740386 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae72be39-ed8b-4002-b8e4-a4654f859b7f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:08.741315 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae72be39-ed8b-4002-b8e4-a4654f859b7f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:08.741995 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae72be39-ed8b-4002-b8e4-a4654f859b7f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:08.743616 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae72be39-ed8b-4002-b8e4-a4654f859b7f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:08.744324 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae72be39-ed8b-4002-b8e4-a4654f859b7f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:08.745711 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae72be39-ed8b-4002-b8e4-a4654f859b7f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:09.107990 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ae72be39-ed8b-4002-b8e4-a4654f859b7f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:09.116694 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ae72be39-ed8b-4002-b8e4-a4654f859b7f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1516 microversion: 2.1 time: 0.393384 Sep 07 15:57:09.117325 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 103/197] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:08 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1516 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:09.140427 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8ce72f5c-a214-4d4c-82d1-ae8f4ea96fe4 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:57:09.143207 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8ce72f5c-a214-4d4c-82d1-ae8f4ea96fe4 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:09.152834 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ce72f5c-a214-4d4c-82d1-ae8f4ea96fe4 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:09.161202 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ce72f5c-a214-4d4c-82d1-ae8f4ea96fe4 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:09.162593 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ce72f5c-a214-4d4c-82d1-ae8f4ea96fe4 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:09.163515 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ce72f5c-a214-4d4c-82d1-ae8f4ea96fe4 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:09.164351 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ce72f5c-a214-4d4c-82d1-ae8f4ea96fe4 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:09.164928 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ce72f5c-a214-4d4c-82d1-ae8f4ea96fe4 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:09.197472 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-8ce72f5c-a214-4d4c-82d1-ae8f4ea96fe4 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lazy-loading 'flavor' on Instance uuid 546eacb2-a6cd-44c7-8abf-97798497d947 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 15:57:09.334469 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8ce72f5c-a214-4d4c-82d1-ae8f4ea96fe4 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "POST /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947/action" status: 200 len: 32 microversion: 2.1 time: 0.197532 Sep 07 15:57:09.334800 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 104/198] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Sep 7 15:57:09 2022] POST /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947/action => generated 32 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 07 15:57:09.346047 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-03951d3b-a18e-426b-94f9-6538946d6874 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:09.346740 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-03951d3b-a18e-426b-94f9-6538946d6874 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:09.354911 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-03951d3b-a18e-426b-94f9-6538946d6874 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:09.355404 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-03951d3b-a18e-426b-94f9-6538946d6874 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:09.355869 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-03951d3b-a18e-426b-94f9-6538946d6874 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:09.356564 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-03951d3b-a18e-426b-94f9-6538946d6874 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:09.357013 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-03951d3b-a18e-426b-94f9-6538946d6874 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:09.357432 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-03951d3b-a18e-426b-94f9-6538946d6874 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:09.655987 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-03951d3b-a18e-426b-94f9-6538946d6874 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:09.665882 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-03951d3b-a18e-426b-94f9-6538946d6874 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1522 microversion: 2.1 time: 0.325476 Sep 07 15:57:09.666447 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 105/199] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:09 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1522 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:10.119879 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-a6d733bd-5645-406a-8509-cd04d81cd8fc req-fc21332c-f1dc-4f5e-9759-503ba62e18a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "331c4dfb-7ee1-4585-bed9-2e65fa1f062a", "tag": "dcda231d-d2f5-41dc-b0c3-658f97c33345"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:57:10.129712 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a6d733bd-5645-406a-8509-cd04d81cd8fc req-fc21332c-f1dc-4f5e-9759-503ba62e18a0 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:10.130393 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a6d733bd-5645-406a-8509-cd04d81cd8fc req-fc21332c-f1dc-4f5e-9759-503ba62e18a0 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:10.130798 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a6d733bd-5645-406a-8509-cd04d81cd8fc req-fc21332c-f1dc-4f5e-9759-503ba62e18a0 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:10.142356 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-a6d733bd-5645-406a-8509-cd04d81cd8fc req-fc21332c-f1dc-4f5e-9759-503ba62e18a0 service nova] Creating event network-changed:dcda231d-d2f5-41dc-b0c3-658f97c33345 for instance 331c4dfb-7ee1-4585-bed9-2e65fa1f062a on hv-cinder-85331 Sep 07 15:57:10.147314 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-a6d733bd-5645-406a-8509-cd04d81cd8fc req-fc21332c-f1dc-4f5e-9759-503ba62e18a0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030962 Sep 07 15:57:10.148226 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 106/200] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 15:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 15:57:10.691173 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-71df55f0-d3c1-4161-9c5c-6fa4ccd6a24a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:10.692457 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-71df55f0-d3c1-4161-9c5c-6fa4ccd6a24a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:10.699957 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71df55f0-d3c1-4161-9c5c-6fa4ccd6a24a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:10.700827 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71df55f0-d3c1-4161-9c5c-6fa4ccd6a24a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:10.701265 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71df55f0-d3c1-4161-9c5c-6fa4ccd6a24a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:10.702037 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71df55f0-d3c1-4161-9c5c-6fa4ccd6a24a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:10.702494 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71df55f0-d3c1-4161-9c5c-6fa4ccd6a24a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:10.702917 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71df55f0-d3c1-4161-9c5c-6fa4ccd6a24a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:11.057567 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-71df55f0-d3c1-4161-9c5c-6fa4ccd6a24a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:11.066334 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-71df55f0-d3c1-4161-9c5c-6fa4ccd6a24a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1522 microversion: 2.1 time: 0.380837 Sep 07 15:57:11.067002 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 107/201] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:10 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1522 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:12.094030 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d5140081-bfb0-4907-b346-0c709fae5287 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:12.097394 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d5140081-bfb0-4907-b346-0c709fae5287 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:12.106785 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5140081-bfb0-4907-b346-0c709fae5287 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:12.107608 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5140081-bfb0-4907-b346-0c709fae5287 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:12.108052 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5140081-bfb0-4907-b346-0c709fae5287 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:12.108909 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5140081-bfb0-4907-b346-0c709fae5287 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:12.109730 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5140081-bfb0-4907-b346-0c709fae5287 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:12.110308 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5140081-bfb0-4907-b346-0c709fae5287 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:12.261514 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d5140081-bfb0-4907-b346-0c709fae5287 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:12.269838 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d5140081-bfb0-4907-b346-0c709fae5287 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1522 microversion: 2.1 time: 0.183425 Sep 07 15:57:12.270521 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 108/202] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:12 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:57:13.293253 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-517a4a1a-3ba4-40c9-bf23-4c2fc971e9ed tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:13.293910 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-517a4a1a-3ba4-40c9-bf23-4c2fc971e9ed tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:13.300910 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-517a4a1a-3ba4-40c9-bf23-4c2fc971e9ed tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:13.301510 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-517a4a1a-3ba4-40c9-bf23-4c2fc971e9ed tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:13.301855 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-517a4a1a-3ba4-40c9-bf23-4c2fc971e9ed tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:13.302530 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-517a4a1a-3ba4-40c9-bf23-4c2fc971e9ed tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:13.302979 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-517a4a1a-3ba4-40c9-bf23-4c2fc971e9ed tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:13.303405 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-517a4a1a-3ba4-40c9-bf23-4c2fc971e9ed tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:13.306454 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:13.328692 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-da89fe23-7a39-47ee-9cd6-2a01edb35dfd tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "POST /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.559420 Sep 07 15:57:13.329736 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 95/203] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Sep 7 15:57:07 2022] POST /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a/os-volume_attachments => generated 194 bytes in 5561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 15:57:13.450329 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-517a4a1a-3ba4-40c9-bf23-4c2fc971e9ed tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:13.458032 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-517a4a1a-3ba4-40c9-bf23-4c2fc971e9ed tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1522 microversion: 2.1 time: 0.168940 Sep 07 15:57:13.458586 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 109/204] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:13 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:57:14.482388 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4a7f179c-4c3f-4dc3-9f54-9e4505dd7c2f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:14.483143 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4a7f179c-4c3f-4dc3-9f54-9e4505dd7c2f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:14.490431 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a7f179c-4c3f-4dc3-9f54-9e4505dd7c2f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:14.490983 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a7f179c-4c3f-4dc3-9f54-9e4505dd7c2f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:14.491480 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a7f179c-4c3f-4dc3-9f54-9e4505dd7c2f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:14.492248 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a7f179c-4c3f-4dc3-9f54-9e4505dd7c2f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:14.492694 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a7f179c-4c3f-4dc3-9f54-9e4505dd7c2f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:14.493308 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4a7f179c-4c3f-4dc3-9f54-9e4505dd7c2f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:14.626585 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-4a7f179c-4c3f-4dc3-9f54-9e4505dd7c2f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:14.634369 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4a7f179c-4c3f-4dc3-9f54-9e4505dd7c2f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1522 microversion: 2.1 time: 0.156192 Sep 07 15:57:14.634923 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 96/205] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:14 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:15.658066 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c3c676e5-6261-466c-a564-ab2fd0f27b13 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:15.658679 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c3c676e5-6261-466c-a564-ab2fd0f27b13 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:15.664983 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c3c676e5-6261-466c-a564-ab2fd0f27b13 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:15.665465 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c3c676e5-6261-466c-a564-ab2fd0f27b13 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:15.665906 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c3c676e5-6261-466c-a564-ab2fd0f27b13 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:15.666600 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c3c676e5-6261-466c-a564-ab2fd0f27b13 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:15.667027 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c3c676e5-6261-466c-a564-ab2fd0f27b13 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:15.667448 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c3c676e5-6261-466c-a564-ab2fd0f27b13 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:15.834444 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c3c676e5-6261-466c-a564-ab2fd0f27b13 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:15.842728 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c3c676e5-6261-466c-a564-ab2fd0f27b13 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1522 microversion: 2.1 time: 0.189130 Sep 07 15:57:15.843295 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 110/206] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:15 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:57:16.867229 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0410dd7f-f232-4168-9d93-60fe8994085a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:16.868294 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0410dd7f-f232-4168-9d93-60fe8994085a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:16.876662 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0410dd7f-f232-4168-9d93-60fe8994085a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:16.877428 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0410dd7f-f232-4168-9d93-60fe8994085a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:16.877861 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0410dd7f-f232-4168-9d93-60fe8994085a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:16.878553 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0410dd7f-f232-4168-9d93-60fe8994085a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:16.879001 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0410dd7f-f232-4168-9d93-60fe8994085a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:16.879424 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0410dd7f-f232-4168-9d93-60fe8994085a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:17.191223 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-0410dd7f-f232-4168-9d93-60fe8994085a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:17.199642 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0410dd7f-f232-4168-9d93-60fe8994085a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1522 microversion: 2.1 time: 0.336393 Sep 07 15:57:17.200638 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 97/207] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:16 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1522 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:18.225613 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b9a987a4-7469-4947-be84-630e57f61195 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:18.226477 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b9a987a4-7469-4947-be84-630e57f61195 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:18.232568 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9a987a4-7469-4947-be84-630e57f61195 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:18.232991 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9a987a4-7469-4947-be84-630e57f61195 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:18.233424 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9a987a4-7469-4947-be84-630e57f61195 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:18.234105 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9a987a4-7469-4947-be84-630e57f61195 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:18.234556 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9a987a4-7469-4947-be84-630e57f61195 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:18.234980 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b9a987a4-7469-4947-be84-630e57f61195 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:18.368335 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b9a987a4-7469-4947-be84-630e57f61195 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:18.375849 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b9a987a4-7469-4947-be84-630e57f61195 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1522 microversion: 2.1 time: 0.154036 Sep 07 15:57:18.376408 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 111/208] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:18 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:19.401026 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a1e89395-d238-4cb0-bfcc-49227284bb08 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:19.402019 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a1e89395-d238-4cb0-bfcc-49227284bb08 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:19.410238 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a1e89395-d238-4cb0-bfcc-49227284bb08 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:19.411113 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a1e89395-d238-4cb0-bfcc-49227284bb08 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:19.411766 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a1e89395-d238-4cb0-bfcc-49227284bb08 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:19.412457 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a1e89395-d238-4cb0-bfcc-49227284bb08 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:19.412904 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a1e89395-d238-4cb0-bfcc-49227284bb08 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:19.413324 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a1e89395-d238-4cb0-bfcc-49227284bb08 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:19.555340 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-a1e89395-d238-4cb0-bfcc-49227284bb08 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:19.563203 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a1e89395-d238-4cb0-bfcc-49227284bb08 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1522 microversion: 2.1 time: 0.168347 Sep 07 15:57:19.564316 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 98/209] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:19 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:20.587654 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-230f22fe-f614-448a-92b9-701913259911 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:20.588279 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-230f22fe-f614-448a-92b9-701913259911 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:20.595523 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-230f22fe-f614-448a-92b9-701913259911 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:20.596253 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-230f22fe-f614-448a-92b9-701913259911 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:20.596702 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-230f22fe-f614-448a-92b9-701913259911 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:20.597407 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-230f22fe-f614-448a-92b9-701913259911 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:20.598171 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-230f22fe-f614-448a-92b9-701913259911 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:20.598743 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-230f22fe-f614-448a-92b9-701913259911 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:20.603506 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:20.743902 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-230f22fe-f614-448a-92b9-701913259911 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:20.751531 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-230f22fe-f614-448a-92b9-701913259911 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1522 microversion: 2.1 time: 0.169045 Sep 07 15:57:20.752100 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 112/210] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:20 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:21.776146 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-00e4687a-afac-4a4e-930f-f865555da379 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:21.776852 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-00e4687a-afac-4a4e-930f-f865555da379 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:21.786333 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00e4687a-afac-4a4e-930f-f865555da379 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:21.786811 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00e4687a-afac-4a4e-930f-f865555da379 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:21.787235 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00e4687a-afac-4a4e-930f-f865555da379 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:21.787945 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00e4687a-afac-4a4e-930f-f865555da379 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:21.788548 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00e4687a-afac-4a4e-930f-f865555da379 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:21.788969 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00e4687a-afac-4a4e-930f-f865555da379 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:21.919398 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-00e4687a-afac-4a4e-930f-f865555da379 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:21.938971 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-00e4687a-afac-4a4e-930f-f865555da379 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1522 microversion: 2.1 time: 0.166262 Sep 07 15:57:21.940085 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 99/211] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:21 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:22.963692 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e839ec6f-c4f2-489b-9be3-5b7c4a6a3579 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:22.964896 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e839ec6f-c4f2-489b-9be3-5b7c4a6a3579 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:22.972332 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e839ec6f-c4f2-489b-9be3-5b7c4a6a3579 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:22.973035 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e839ec6f-c4f2-489b-9be3-5b7c4a6a3579 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:22.973567 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e839ec6f-c4f2-489b-9be3-5b7c4a6a3579 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:22.974352 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e839ec6f-c4f2-489b-9be3-5b7c4a6a3579 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:22.975253 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e839ec6f-c4f2-489b-9be3-5b7c4a6a3579 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:22.975368 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e839ec6f-c4f2-489b-9be3-5b7c4a6a3579 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:23.132949 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e839ec6f-c4f2-489b-9be3-5b7c4a6a3579 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:23.141069 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e839ec6f-c4f2-489b-9be3-5b7c4a6a3579 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1522 microversion: 2.1 time: 0.182693 Sep 07 15:57:23.142031 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 113/212] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:22 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:24.168069 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1cbe46c8-db11-4b30-a821-2d5dce744974 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:24.168752 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1cbe46c8-db11-4b30-a821-2d5dce744974 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:24.176389 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1cbe46c8-db11-4b30-a821-2d5dce744974 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:24.176970 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1cbe46c8-db11-4b30-a821-2d5dce744974 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:24.177616 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1cbe46c8-db11-4b30-a821-2d5dce744974 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:24.178696 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1cbe46c8-db11-4b30-a821-2d5dce744974 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:24.179472 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1cbe46c8-db11-4b30-a821-2d5dce744974 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:24.180111 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1cbe46c8-db11-4b30-a821-2d5dce744974 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:24.395013 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-1cbe46c8-db11-4b30-a821-2d5dce744974 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:24.404707 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1cbe46c8-db11-4b30-a821-2d5dce744974 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1522 microversion: 2.1 time: 0.242233 Sep 07 15:57:24.405532 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 100/213] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:24 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:25.427750 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5f1b4974-83af-40c7-a5a7-c9b3bd58ad43 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:25.428359 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5f1b4974-83af-40c7-a5a7-c9b3bd58ad43 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:25.434560 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f1b4974-83af-40c7-a5a7-c9b3bd58ad43 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:25.435038 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f1b4974-83af-40c7-a5a7-c9b3bd58ad43 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:25.435575 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f1b4974-83af-40c7-a5a7-c9b3bd58ad43 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:25.436224 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f1b4974-83af-40c7-a5a7-c9b3bd58ad43 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:25.436857 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f1b4974-83af-40c7-a5a7-c9b3bd58ad43 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:25.437284 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f1b4974-83af-40c7-a5a7-c9b3bd58ad43 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:25.614791 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5f1b4974-83af-40c7-a5a7-c9b3bd58ad43 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:25.622946 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5f1b4974-83af-40c7-a5a7-c9b3bd58ad43 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1522 microversion: 2.1 time: 0.199214 Sep 07 15:57:25.623665 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 114/214] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:25 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:26.650263 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c233a7b8-2bef-4a47-8844-5800a9e3964a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:26.650885 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c233a7b8-2bef-4a47-8844-5800a9e3964a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:26.657870 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c233a7b8-2bef-4a47-8844-5800a9e3964a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:26.658451 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c233a7b8-2bef-4a47-8844-5800a9e3964a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:26.658977 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c233a7b8-2bef-4a47-8844-5800a9e3964a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:26.659920 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c233a7b8-2bef-4a47-8844-5800a9e3964a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:26.660552 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c233a7b8-2bef-4a47-8844-5800a9e3964a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:26.661093 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c233a7b8-2bef-4a47-8844-5800a9e3964a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:26.792594 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-c233a7b8-2bef-4a47-8844-5800a9e3964a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:26.801123 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c233a7b8-2bef-4a47-8844-5800a9e3964a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1522 microversion: 2.1 time: 0.154799 Sep 07 15:57:26.801680 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 101/215] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:26 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:27.824440 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e8f794a6-9fc9-426b-9bbf-91e19304b075 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:27.825072 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e8f794a6-9fc9-426b-9bbf-91e19304b075 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:27.832192 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8f794a6-9fc9-426b-9bbf-91e19304b075 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:27.832761 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8f794a6-9fc9-426b-9bbf-91e19304b075 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:27.833260 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8f794a6-9fc9-426b-9bbf-91e19304b075 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:27.833957 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8f794a6-9fc9-426b-9bbf-91e19304b075 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:27.834413 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8f794a6-9fc9-426b-9bbf-91e19304b075 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:27.834828 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8f794a6-9fc9-426b-9bbf-91e19304b075 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:27.965963 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e8f794a6-9fc9-426b-9bbf-91e19304b075 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:27.973976 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e8f794a6-9fc9-426b-9bbf-91e19304b075 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1522 microversion: 2.1 time: 0.154323 Sep 07 15:57:27.974528 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 115/216] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:27 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:29.001782 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0a6275da-47b4-415e-a9da-44cf1612673e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:29.002373 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0a6275da-47b4-415e-a9da-44cf1612673e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:29.011227 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0a6275da-47b4-415e-a9da-44cf1612673e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:29.011774 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0a6275da-47b4-415e-a9da-44cf1612673e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:29.012213 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0a6275da-47b4-415e-a9da-44cf1612673e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:29.013057 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0a6275da-47b4-415e-a9da-44cf1612673e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:29.013639 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0a6275da-47b4-415e-a9da-44cf1612673e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:29.014002 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0a6275da-47b4-415e-a9da-44cf1612673e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:29.150147 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-0a6275da-47b4-415e-a9da-44cf1612673e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:29.158377 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0a6275da-47b4-415e-a9da-44cf1612673e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1522 microversion: 2.1 time: 0.160923 Sep 07 15:57:29.161455 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 102/217] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:28 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:30.182933 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fc038d62-0441-4b73-8b93-a30a09de7021 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:30.183578 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fc038d62-0441-4b73-8b93-a30a09de7021 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:30.190003 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc038d62-0441-4b73-8b93-a30a09de7021 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:30.190471 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc038d62-0441-4b73-8b93-a30a09de7021 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:30.190897 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc038d62-0441-4b73-8b93-a30a09de7021 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:30.191689 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc038d62-0441-4b73-8b93-a30a09de7021 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:30.192068 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc038d62-0441-4b73-8b93-a30a09de7021 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:30.192524 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc038d62-0441-4b73-8b93-a30a09de7021 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:30.326123 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-fc038d62-0441-4b73-8b93-a30a09de7021 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:30.334069 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fc038d62-0441-4b73-8b93-a30a09de7021 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1522 microversion: 2.1 time: 0.154900 Sep 07 15:57:30.334622 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 116/218] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:30 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:31.357429 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d0a2cbc3-23c3-4ba5-b630-7fa8e4a63dcf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:31.358062 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d0a2cbc3-23c3-4ba5-b630-7fa8e4a63dcf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:31.360539 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=34 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:31.366366 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d0a2cbc3-23c3-4ba5-b630-7fa8e4a63dcf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:31.366847 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d0a2cbc3-23c3-4ba5-b630-7fa8e4a63dcf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:31.367273 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d0a2cbc3-23c3-4ba5-b630-7fa8e4a63dcf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:31.367992 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d0a2cbc3-23c3-4ba5-b630-7fa8e4a63dcf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:31.368442 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d0a2cbc3-23c3-4ba5-b630-7fa8e4a63dcf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:31.368858 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d0a2cbc3-23c3-4ba5-b630-7fa8e4a63dcf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:31.497155 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-d0a2cbc3-23c3-4ba5-b630-7fa8e4a63dcf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:31.505861 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d0a2cbc3-23c3-4ba5-b630-7fa8e4a63dcf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1522 microversion: 2.1 time: 0.152193 Sep 07 15:57:31.506430 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 103/219] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:31 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:32.528303 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-259b641e-7bef-48c3-938e-41561976f7ab tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:32.528917 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-259b641e-7bef-48c3-938e-41561976f7ab tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:32.530784 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=46 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:32.536893 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-259b641e-7bef-48c3-938e-41561976f7ab tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:32.537378 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-259b641e-7bef-48c3-938e-41561976f7ab tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:32.537813 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-259b641e-7bef-48c3-938e-41561976f7ab tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:32.538498 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-259b641e-7bef-48c3-938e-41561976f7ab tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:32.538950 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-259b641e-7bef-48c3-938e-41561976f7ab tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:32.539373 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-259b641e-7bef-48c3-938e-41561976f7ab tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:32.664920 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-259b641e-7bef-48c3-938e-41561976f7ab tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:32.674552 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-259b641e-7bef-48c3-938e-41561976f7ab tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1522 microversion: 2.1 time: 0.149978 Sep 07 15:57:32.675127 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 117/220] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:32 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:33.697926 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d00ecbcc-fc98-4e7f-bba4-08503e40ad61 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:33.698599 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d00ecbcc-fc98-4e7f-bba4-08503e40ad61 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:33.704997 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d00ecbcc-fc98-4e7f-bba4-08503e40ad61 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:33.705474 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d00ecbcc-fc98-4e7f-bba4-08503e40ad61 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:33.705931 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d00ecbcc-fc98-4e7f-bba4-08503e40ad61 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:33.706606 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d00ecbcc-fc98-4e7f-bba4-08503e40ad61 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:33.707047 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d00ecbcc-fc98-4e7f-bba4-08503e40ad61 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:33.707464 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d00ecbcc-fc98-4e7f-bba4-08503e40ad61 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:33.841695 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-d00ecbcc-fc98-4e7f-bba4-08503e40ad61 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:33.850014 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d00ecbcc-fc98-4e7f-bba4-08503e40ad61 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1522 microversion: 2.1 time: 0.156105 Sep 07 15:57:33.850565 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 104/221] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:33 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:34.872517 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f52cbb29-c6ca-4f93-bb0c-0c150d4bf240 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:34.873052 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f52cbb29-c6ca-4f93-bb0c-0c150d4bf240 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:34.879052 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f52cbb29-c6ca-4f93-bb0c-0c150d4bf240 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:34.879528 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f52cbb29-c6ca-4f93-bb0c-0c150d4bf240 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:34.879992 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f52cbb29-c6ca-4f93-bb0c-0c150d4bf240 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:34.880668 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f52cbb29-c6ca-4f93-bb0c-0c150d4bf240 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:34.881116 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f52cbb29-c6ca-4f93-bb0c-0c150d4bf240 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:34.881537 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f52cbb29-c6ca-4f93-bb0c-0c150d4bf240 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:35.012647 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f52cbb29-c6ca-4f93-bb0c-0c150d4bf240 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:35.020332 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f52cbb29-c6ca-4f93-bb0c-0c150d4bf240 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1522 microversion: 2.1 time: 0.151661 Sep 07 15:57:35.020886 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 118/222] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:34 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:36.043617 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8729eb3a-b3fc-4d91-85d5-ac3b1c71cf8c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:36.044259 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8729eb3a-b3fc-4d91-85d5-ac3b1c71cf8c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:36.051471 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8729eb3a-b3fc-4d91-85d5-ac3b1c71cf8c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:36.052061 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8729eb3a-b3fc-4d91-85d5-ac3b1c71cf8c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:36.052551 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8729eb3a-b3fc-4d91-85d5-ac3b1c71cf8c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:36.053252 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8729eb3a-b3fc-4d91-85d5-ac3b1c71cf8c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:36.053698 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8729eb3a-b3fc-4d91-85d5-ac3b1c71cf8c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:36.054113 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8729eb3a-b3fc-4d91-85d5-ac3b1c71cf8c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:36.200424 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-8729eb3a-b3fc-4d91-85d5-ac3b1c71cf8c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:36.209023 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8729eb3a-b3fc-4d91-85d5-ac3b1c71cf8c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1522 microversion: 2.1 time: 0.169295 Sep 07 15:57:36.209584 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 105/223] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:36 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:37.237644 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dd108518-17a0-4db1-881c-3dd8a1738800 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:37.238247 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dd108518-17a0-4db1-881c-3dd8a1738800 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:37.244200 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd108518-17a0-4db1-881c-3dd8a1738800 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:37.244683 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd108518-17a0-4db1-881c-3dd8a1738800 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:37.245115 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd108518-17a0-4db1-881c-3dd8a1738800 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:37.245795 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd108518-17a0-4db1-881c-3dd8a1738800 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:37.246241 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd108518-17a0-4db1-881c-3dd8a1738800 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:37.246663 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dd108518-17a0-4db1-881c-3dd8a1738800 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:37.372008 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-dd108518-17a0-4db1-881c-3dd8a1738800 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:37.379999 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dd108518-17a0-4db1-881c-3dd8a1738800 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1522 microversion: 2.1 time: 0.146618 Sep 07 15:57:37.380554 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 119/224] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:37 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:38.403669 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-82c396f5-35c8-4b4f-ba75-76498e9e6ea8 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:38.404266 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-82c396f5-35c8-4b4f-ba75-76498e9e6ea8 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:38.410752 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-82c396f5-35c8-4b4f-ba75-76498e9e6ea8 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:38.411271 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-82c396f5-35c8-4b4f-ba75-76498e9e6ea8 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:38.411675 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-82c396f5-35c8-4b4f-ba75-76498e9e6ea8 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:38.412347 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-82c396f5-35c8-4b4f-ba75-76498e9e6ea8 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:38.412793 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-82c396f5-35c8-4b4f-ba75-76498e9e6ea8 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:38.413208 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-82c396f5-35c8-4b4f-ba75-76498e9e6ea8 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:38.544554 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-82c396f5-35c8-4b4f-ba75-76498e9e6ea8 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:38.552704 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-82c396f5-35c8-4b4f-ba75-76498e9e6ea8 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1522 microversion: 2.1 time: 0.152977 Sep 07 15:57:38.553269 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 106/225] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:38 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:39.431789 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f8750f46-0e91-4fd0-aec7-ebafc8eca16e tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-492644118", "imageRef": "cfe19284-9779-46f4-b458-81d5475ec82f", "flavorRef": "452", "networks": [{"uuid": "7e254e5b-3167-44b3-9e81-f229655afc11"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:57:39.576504 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8c04143d-a0e6-4586-aee2-08a0cbd3ef47 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:39.577094 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8c04143d-a0e6-4586-aee2-08a0cbd3ef47 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:39.583753 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8c04143d-a0e6-4586-aee2-08a0cbd3ef47 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:39.584284 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8c04143d-a0e6-4586-aee2-08a0cbd3ef47 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:39.584742 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8c04143d-a0e6-4586-aee2-08a0cbd3ef47 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:39.585417 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8c04143d-a0e6-4586-aee2-08a0cbd3ef47 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:39.585862 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8c04143d-a0e6-4586-aee2-08a0cbd3ef47 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:39.586277 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8c04143d-a0e6-4586-aee2-08a0cbd3ef47 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:39.730334 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-8c04143d-a0e6-4586-aee2-08a0cbd3ef47 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:39.738867 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8c04143d-a0e6-4586-aee2-08a0cbd3ef47 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1522 microversion: 2.1 time: 0.166091 Sep 07 15:57:39.739446 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 107/226] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:39 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:57:40.761784 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-40c3f6e5-dbaf-4eaf-a0fa-f56e7a8b0a33 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:40.762419 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-40c3f6e5-dbaf-4eaf-a0fa-f56e7a8b0a33 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:40.768792 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40c3f6e5-dbaf-4eaf-a0fa-f56e7a8b0a33 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:40.769273 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40c3f6e5-dbaf-4eaf-a0fa-f56e7a8b0a33 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:40.769701 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40c3f6e5-dbaf-4eaf-a0fa-f56e7a8b0a33 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:40.770375 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40c3f6e5-dbaf-4eaf-a0fa-f56e7a8b0a33 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:40.770827 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40c3f6e5-dbaf-4eaf-a0fa-f56e7a8b0a33 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:40.771242 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-40c3f6e5-dbaf-4eaf-a0fa-f56e7a8b0a33 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:40.850471 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-f8750f46-0e91-4fd0-aec7-ebafc8eca16e tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] validate_networks() for [('7e254e5b-3167-44b3-9e81-f229655afc11', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 15:57:40.902054 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-40c3f6e5-dbaf-4eaf-a0fa-f56e7a8b0a33 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:40.910665 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-40c3f6e5-dbaf-4eaf-a0fa-f56e7a8b0a33 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1522 microversion: 2.1 time: 0.152620 Sep 07 15:57:40.913354 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 108/227] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:40 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:57:41.225122 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-f8750f46-0e91-4fd0-aec7-ebafc8eca16e tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 15:57:41.225656 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-f8750f46-0e91-4fd0-aec7-ebafc8eca16e tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 15:57:41.226428 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-f8750f46-0e91-4fd0-aec7-ebafc8eca16e tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 15:57:41.226865 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-f8750f46-0e91-4fd0-aec7-ebafc8eca16e tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 15:57:41.227271 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-f8750f46-0e91-4fd0-aec7-ebafc8eca16e tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 15:57:41.236856 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8750f46-0e91-4fd0-aec7-ebafc8eca16e tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:41.237326 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8750f46-0e91-4fd0-aec7-ebafc8eca16e tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:41.237757 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8750f46-0e91-4fd0-aec7-ebafc8eca16e tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:41.238480 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8750f46-0e91-4fd0-aec7-ebafc8eca16e tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:41.238930 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8750f46-0e91-4fd0-aec7-ebafc8eca16e tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:41.239357 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8750f46-0e91-4fd0-aec7-ebafc8eca16e tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:41.257013 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-f8750f46-0e91-4fd0-aec7-ebafc8eca16e tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Getting quotas for project 4ebf52e3718140d1b2e4883f8d5464f4. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 15:57:41.261030 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-f8750f46-0e91-4fd0-aec7-ebafc8eca16e tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Getting quotas for user 72a393cb6b2343d697ec2e87d750c70a and project 4ebf52e3718140d1b2e4883f8d5464f4. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 15:57:41.272582 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f8750f46-0e91-4fd0-aec7-ebafc8eca16e tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 15:57:41.274813 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f8750f46-0e91-4fd0-aec7-ebafc8eca16e tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] [instance: af97f825-9004-4c4d-a0da-479b2465b189] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cfe19284-9779-46f4-b458-81d5475ec82f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 15:57:41.324745 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f8750f46-0e91-4fd0-aec7-ebafc8eca16e tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.897722 Sep 07 15:57:41.325367 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 120/228] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Sep 7 15:57:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1900 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 15:57:41.337713 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-05dd5741-7833-435b-a91e-4154245c9c2e tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:41.338546 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-05dd5741-7833-435b-a91e-4154245c9c2e tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] [instance: af97f825-9004-4c4d-a0da-479b2465b189] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:41.416430 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-05dd5741-7833-435b-a91e-4154245c9c2e tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a393cb6b2343d697ec2e87d750c70a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf52e3718140d1b2e4883f8d5464f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:41.429814 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-05dd5741-7833-435b-a91e-4154245c9c2e tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] 10.222.0.17 "GET /compute/v2.1/servers/af97f825-9004-4c4d-a0da-479b2465b189" status: 200 len: 1213 microversion: 2.1 time: 0.096789 Sep 07 15:57:41.430610 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 109/229] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:41 2022] GET /compute/v2.1/servers/af97f825-9004-4c4d-a0da-479b2465b189 => generated 1213 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:41.935285 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-85dc2399-6b4f-4efe-aea1-b77cec63f44a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:41.935966 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-85dc2399-6b4f-4efe-aea1-b77cec63f44a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:41.942858 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85dc2399-6b4f-4efe-aea1-b77cec63f44a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:41.943338 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85dc2399-6b4f-4efe-aea1-b77cec63f44a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:41.943800 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85dc2399-6b4f-4efe-aea1-b77cec63f44a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:41.944488 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85dc2399-6b4f-4efe-aea1-b77cec63f44a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:41.944940 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85dc2399-6b4f-4efe-aea1-b77cec63f44a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:41.945361 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85dc2399-6b4f-4efe-aea1-b77cec63f44a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:42.077091 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-85dc2399-6b4f-4efe-aea1-b77cec63f44a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:42.085511 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-85dc2399-6b4f-4efe-aea1-b77cec63f44a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1522 microversion: 2.1 time: 0.155379 Sep 07 15:57:42.086075 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 121/230] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:41 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:42.463170 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e95e3a06-4d29-44e1-b775-75828b364231 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:42.463851 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e95e3a06-4d29-44e1-b775-75828b364231 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] [instance: af97f825-9004-4c4d-a0da-479b2465b189] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:42.469979 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e95e3a06-4d29-44e1-b775-75828b364231 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:42.470458 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e95e3a06-4d29-44e1-b775-75828b364231 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:42.470897 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e95e3a06-4d29-44e1-b775-75828b364231 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:42.471607 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e95e3a06-4d29-44e1-b775-75828b364231 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:42.472058 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e95e3a06-4d29-44e1-b775-75828b364231 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:42.472476 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e95e3a06-4d29-44e1-b775-75828b364231 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:42.547387 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-e95e3a06-4d29-44e1-b775-75828b364231 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a393cb6b2343d697ec2e87d750c70a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf52e3718140d1b2e4883f8d5464f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:42.555203 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e95e3a06-4d29-44e1-b775-75828b364231 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] 10.222.0.17 "GET /compute/v2.1/servers/af97f825-9004-4c4d-a0da-479b2465b189" status: 200 len: 1265 microversion: 2.1 time: 0.095874 Sep 07 15:57:42.555783 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 110/231] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:42 2022] GET /compute/v2.1/servers/af97f825-9004-4c4d-a0da-479b2465b189 => generated 1265 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:43.110608 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-369950cb-b662-4ec3-9102-dec91ec7b9c4 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:43.111421 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-369950cb-b662-4ec3-9102-dec91ec7b9c4 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:43.117239 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-369950cb-b662-4ec3-9102-dec91ec7b9c4 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:43.117708 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-369950cb-b662-4ec3-9102-dec91ec7b9c4 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:43.118160 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-369950cb-b662-4ec3-9102-dec91ec7b9c4 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:43.118831 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-369950cb-b662-4ec3-9102-dec91ec7b9c4 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:43.119272 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-369950cb-b662-4ec3-9102-dec91ec7b9c4 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:43.119842 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-369950cb-b662-4ec3-9102-dec91ec7b9c4 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:43.260833 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-369950cb-b662-4ec3-9102-dec91ec7b9c4 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:43.268952 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-369950cb-b662-4ec3-9102-dec91ec7b9c4 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1522 microversion: 2.1 time: 0.162138 Sep 07 15:57:43.269678 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 122/232] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:43 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:43.579587 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b0f74033-ad27-4ef7-92ea-2167687e9fa4 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:43.580354 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b0f74033-ad27-4ef7-92ea-2167687e9fa4 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] [instance: af97f825-9004-4c4d-a0da-479b2465b189] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:43.594767 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b0f74033-ad27-4ef7-92ea-2167687e9fa4 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:43.595203 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b0f74033-ad27-4ef7-92ea-2167687e9fa4 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:43.595668 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b0f74033-ad27-4ef7-92ea-2167687e9fa4 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:43.596379 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b0f74033-ad27-4ef7-92ea-2167687e9fa4 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:43.599046 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b0f74033-ad27-4ef7-92ea-2167687e9fa4 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:43.599489 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b0f74033-ad27-4ef7-92ea-2167687e9fa4 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:43.613236 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:43.875487 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-b0f74033-ad27-4ef7-92ea-2167687e9fa4 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a393cb6b2343d697ec2e87d750c70a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf52e3718140d1b2e4883f8d5464f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:43.886895 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b0f74033-ad27-4ef7-92ea-2167687e9fa4 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] 10.222.0.17 "GET /compute/v2.1/servers/af97f825-9004-4c4d-a0da-479b2465b189" status: 200 len: 1313 microversion: 2.1 time: 0.312274 Sep 07 15:57:43.899612 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 111/233] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:43 2022] GET /compute/v2.1/servers/af97f825-9004-4c4d-a0da-479b2465b189 => generated 1313 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:44.292077 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-44fe558e-81c3-4561-8f94-6bfde5da8b6e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:44.292805 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-44fe558e-81c3-4561-8f94-6bfde5da8b6e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:44.306989 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44fe558e-81c3-4561-8f94-6bfde5da8b6e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:44.307789 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44fe558e-81c3-4561-8f94-6bfde5da8b6e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:44.308747 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44fe558e-81c3-4561-8f94-6bfde5da8b6e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:44.309582 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44fe558e-81c3-4561-8f94-6bfde5da8b6e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:44.310264 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44fe558e-81c3-4561-8f94-6bfde5da8b6e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:44.313889 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44fe558e-81c3-4561-8f94-6bfde5da8b6e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:44.393171 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-6f1d1aba-8d74-41c3-b436-220c5b52f258 req-58bb5ec3-ad70-4e61-bf2b-96f5634ed070 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af97f825-9004-4c4d-a0da-479b2465b189", "tag": "30b26de7-eda7-43df-a617-41c604f06a9a"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:57:44.404364 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-6f1d1aba-8d74-41c3-b436-220c5b52f258 req-58bb5ec3-ad70-4e61-bf2b-96f5634ed070 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:44.407111 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-6f1d1aba-8d74-41c3-b436-220c5b52f258 req-58bb5ec3-ad70-4e61-bf2b-96f5634ed070 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:44.407906 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-6f1d1aba-8d74-41c3-b436-220c5b52f258 req-58bb5ec3-ad70-4e61-bf2b-96f5634ed070 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:44.428348 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-6f1d1aba-8d74-41c3-b436-220c5b52f258 req-58bb5ec3-ad70-4e61-bf2b-96f5634ed070 service nova] Creating event network-changed:30b26de7-eda7-43df-a617-41c604f06a9a for instance af97f825-9004-4c4d-a0da-479b2465b189 on hv-cinder-85331 Sep 07 15:57:44.442354 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-6f1d1aba-8d74-41c3-b436-220c5b52f258 req-58bb5ec3-ad70-4e61-bf2b-96f5634ed070 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054049 Sep 07 15:57:44.444123 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 112/234] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 15:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:57:44.511991 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-44fe558e-81c3-4561-8f94-6bfde5da8b6e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:44.522191 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-44fe558e-81c3-4561-8f94-6bfde5da8b6e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1522 microversion: 2.1 time: 0.233903 Sep 07 15:57:44.522923 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 123/235] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:44 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:44.915152 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-887277a9-53f8-4da6-b1e1-b74bb9cb5693 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:44.916067 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-887277a9-53f8-4da6-b1e1-b74bb9cb5693 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] [instance: af97f825-9004-4c4d-a0da-479b2465b189] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:44.922629 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-887277a9-53f8-4da6-b1e1-b74bb9cb5693 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:44.923227 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-887277a9-53f8-4da6-b1e1-b74bb9cb5693 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:44.923775 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-887277a9-53f8-4da6-b1e1-b74bb9cb5693 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:44.924535 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-887277a9-53f8-4da6-b1e1-b74bb9cb5693 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:44.925062 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-887277a9-53f8-4da6-b1e1-b74bb9cb5693 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:44.925559 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-887277a9-53f8-4da6-b1e1-b74bb9cb5693 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:45.063753 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-887277a9-53f8-4da6-b1e1-b74bb9cb5693 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a393cb6b2343d697ec2e87d750c70a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf52e3718140d1b2e4883f8d5464f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:45.071414 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-887277a9-53f8-4da6-b1e1-b74bb9cb5693 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] 10.222.0.17 "GET /compute/v2.1/servers/af97f825-9004-4c4d-a0da-479b2465b189" status: 200 len: 1313 microversion: 2.1 time: 0.161008 Sep 07 15:57:45.072091 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 113/236] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:44 2022] GET /compute/v2.1/servers/af97f825-9004-4c4d-a0da-479b2465b189 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:45.545900 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-616967c1-72d6-4796-9dda-4a717be8735b tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:45.546512 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-616967c1-72d6-4796-9dda-4a717be8735b tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:45.553254 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-616967c1-72d6-4796-9dda-4a717be8735b tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:45.553734 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-616967c1-72d6-4796-9dda-4a717be8735b tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:45.554170 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-616967c1-72d6-4796-9dda-4a717be8735b tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:45.554871 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-616967c1-72d6-4796-9dda-4a717be8735b tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:45.555302 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-616967c1-72d6-4796-9dda-4a717be8735b tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:45.555764 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-616967c1-72d6-4796-9dda-4a717be8735b tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:45.701142 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-616967c1-72d6-4796-9dda-4a717be8735b tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:45.710968 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-616967c1-72d6-4796-9dda-4a717be8735b tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1522 microversion: 2.1 time: 0.167861 Sep 07 15:57:45.720270 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 124/237] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:45 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:46.095986 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-057cb2b3-32c4-4c69-9099-58291e9a123f tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:46.096676 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-057cb2b3-32c4-4c69-9099-58291e9a123f tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] [instance: af97f825-9004-4c4d-a0da-479b2465b189] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:46.103763 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-057cb2b3-32c4-4c69-9099-58291e9a123f tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:46.104242 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-057cb2b3-32c4-4c69-9099-58291e9a123f tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:46.104671 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-057cb2b3-32c4-4c69-9099-58291e9a123f tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:46.105354 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-057cb2b3-32c4-4c69-9099-58291e9a123f tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:46.105803 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-057cb2b3-32c4-4c69-9099-58291e9a123f tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:46.106223 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-057cb2b3-32c4-4c69-9099-58291e9a123f tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:46.240594 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-057cb2b3-32c4-4c69-9099-58291e9a123f tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a393cb6b2343d697ec2e87d750c70a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf52e3718140d1b2e4883f8d5464f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:46.251333 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-057cb2b3-32c4-4c69-9099-58291e9a123f tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] 10.222.0.17 "GET /compute/v2.1/servers/af97f825-9004-4c4d-a0da-479b2465b189" status: 200 len: 1313 microversion: 2.1 time: 0.159832 Sep 07 15:57:46.266836 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 114/238] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:46 2022] GET /compute/v2.1/servers/af97f825-9004-4c4d-a0da-479b2465b189 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:46.734632 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1dbeacca-128c-487c-a32b-02e528489649 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:46.735253 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1dbeacca-128c-487c-a32b-02e528489649 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:46.741706 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1dbeacca-128c-487c-a32b-02e528489649 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:46.742189 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1dbeacca-128c-487c-a32b-02e528489649 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:46.742620 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1dbeacca-128c-487c-a32b-02e528489649 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:46.743308 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1dbeacca-128c-487c-a32b-02e528489649 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:46.743786 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1dbeacca-128c-487c-a32b-02e528489649 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:46.744205 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1dbeacca-128c-487c-a32b-02e528489649 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:46.892241 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1dbeacca-128c-487c-a32b-02e528489649 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:46.902619 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1dbeacca-128c-487c-a32b-02e528489649 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1522 microversion: 2.1 time: 0.172272 Sep 07 15:57:46.903290 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 125/239] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:46 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:47.274429 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a7a67fb3-b1b1-430e-bcef-b287e9234c1f tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:47.275102 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a7a67fb3-b1b1-430e-bcef-b287e9234c1f tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] [instance: af97f825-9004-4c4d-a0da-479b2465b189] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:47.282962 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a7a67fb3-b1b1-430e-bcef-b287e9234c1f tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:47.283433 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a7a67fb3-b1b1-430e-bcef-b287e9234c1f tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:47.283889 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a7a67fb3-b1b1-430e-bcef-b287e9234c1f tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:47.284568 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a7a67fb3-b1b1-430e-bcef-b287e9234c1f tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:47.285012 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a7a67fb3-b1b1-430e-bcef-b287e9234c1f tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:47.285426 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a7a67fb3-b1b1-430e-bcef-b287e9234c1f tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:47.427327 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-a7a67fb3-b1b1-430e-bcef-b287e9234c1f tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a393cb6b2343d697ec2e87d750c70a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf52e3718140d1b2e4883f8d5464f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:47.449567 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a7a67fb3-b1b1-430e-bcef-b287e9234c1f tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] 10.222.0.17 "GET /compute/v2.1/servers/af97f825-9004-4c4d-a0da-479b2465b189" status: 200 len: 1313 microversion: 2.1 time: 0.178874 Sep 07 15:57:47.461280 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 115/240] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:47 2022] GET /compute/v2.1/servers/af97f825-9004-4c4d-a0da-479b2465b189 => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:47.927927 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d13c4865-9358-4e19-9c1d-811ddd5cb13b tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:47.929599 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d13c4865-9358-4e19-9c1d-811ddd5cb13b tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:47.935502 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d13c4865-9358-4e19-9c1d-811ddd5cb13b tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:47.936166 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d13c4865-9358-4e19-9c1d-811ddd5cb13b tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:47.936925 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d13c4865-9358-4e19-9c1d-811ddd5cb13b tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:47.937647 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d13c4865-9358-4e19-9c1d-811ddd5cb13b tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:47.938093 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d13c4865-9358-4e19-9c1d-811ddd5cb13b tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:47.938508 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d13c4865-9358-4e19-9c1d-811ddd5cb13b tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:47.975528 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6b9c56b6-ce87-453b-8ef3-12cd150ebfb5 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:47.975528 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6b9c56b6-ce87-453b-8ef3-12cd150ebfb5 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:47.981315 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6b9c56b6-ce87-453b-8ef3-12cd150ebfb5 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:47.981808 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6b9c56b6-ce87-453b-8ef3-12cd150ebfb5 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:47.982240 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6b9c56b6-ce87-453b-8ef3-12cd150ebfb5 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:47.983107 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6b9c56b6-ce87-453b-8ef3-12cd150ebfb5 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:47.983582 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6b9c56b6-ce87-453b-8ef3-12cd150ebfb5 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:47.984092 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6b9c56b6-ce87-453b-8ef3-12cd150ebfb5 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:48.012319 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6b9c56b6-ce87-453b-8ef3-12cd150ebfb5 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 15:57:48.097269 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d13c4865-9358-4e19-9c1d-811ddd5cb13b tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:48.107742 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d13c4865-9358-4e19-9c1d-811ddd5cb13b tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1522 microversion: 2.1 time: 0.183377 Sep 07 15:57:48.118967 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 126/241] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:47 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:48.124127 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6b9c56b6-ce87-453b-8ef3-12cd150ebfb5 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "DELETE /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 204 len: 0 microversion: 2.1 time: 0.153761 Sep 07 15:57:48.124746 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 116/242] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Sep 7 15:57:47 2022] DELETE /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 15:57:48.132644 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8b36d478-499d-4490-9238-b05d1783240b tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:48.133275 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8b36d478-499d-4490-9238-b05d1783240b tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:48.139080 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b36d478-499d-4490-9238-b05d1783240b tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:48.139588 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b36d478-499d-4490-9238-b05d1783240b tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:48.140028 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b36d478-499d-4490-9238-b05d1783240b tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:48.141241 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b36d478-499d-4490-9238-b05d1783240b tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:48.141690 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b36d478-499d-4490-9238-b05d1783240b tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:48.142111 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8b36d478-499d-4490-9238-b05d1783240b tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:48.283331 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-8b36d478-499d-4490-9238-b05d1783240b tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:48.291951 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8b36d478-499d-4490-9238-b05d1783240b tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1554 microversion: 2.1 time: 0.162962 Sep 07 15:57:48.293046 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 127/243] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:48 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:48.478944 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dcd77c26-4c83-4db5-9d04-1f7f1d23a278 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:48.479904 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-dcd77c26-4c83-4db5-9d04-1f7f1d23a278 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] [instance: af97f825-9004-4c4d-a0da-479b2465b189] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:48.487936 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dcd77c26-4c83-4db5-9d04-1f7f1d23a278 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:48.488654 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dcd77c26-4c83-4db5-9d04-1f7f1d23a278 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:48.489171 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dcd77c26-4c83-4db5-9d04-1f7f1d23a278 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:48.490072 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dcd77c26-4c83-4db5-9d04-1f7f1d23a278 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:48.490593 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dcd77c26-4c83-4db5-9d04-1f7f1d23a278 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:48.491087 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dcd77c26-4c83-4db5-9d04-1f7f1d23a278 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:48.646237 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-dcd77c26-4c83-4db5-9d04-1f7f1d23a278 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a393cb6b2343d697ec2e87d750c70a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf52e3718140d1b2e4883f8d5464f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:48.653902 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-dcd77c26-4c83-4db5-9d04-1f7f1d23a278 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] 10.222.0.17 "GET /compute/v2.1/servers/af97f825-9004-4c4d-a0da-479b2465b189" status: 200 len: 1313 microversion: 2.1 time: 0.179546 Sep 07 15:57:48.654544 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 117/244] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:48 2022] GET /compute/v2.1/servers/af97f825-9004-4c4d-a0da-479b2465b189 => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:49.130917 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-468a23aa-5168-4cbf-9439-ad3d4062cff8 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:49.131535 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-468a23aa-5168-4cbf-9439-ad3d4062cff8 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:49.138108 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-468a23aa-5168-4cbf-9439-ad3d4062cff8 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:49.138769 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-468a23aa-5168-4cbf-9439-ad3d4062cff8 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:49.139211 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-468a23aa-5168-4cbf-9439-ad3d4062cff8 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:49.139945 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-468a23aa-5168-4cbf-9439-ad3d4062cff8 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:49.140429 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-468a23aa-5168-4cbf-9439-ad3d4062cff8 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:49.140854 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-468a23aa-5168-4cbf-9439-ad3d4062cff8 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:49.281530 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-468a23aa-5168-4cbf-9439-ad3d4062cff8 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:49.291502 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-468a23aa-5168-4cbf-9439-ad3d4062cff8 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1522 microversion: 2.1 time: 0.164462 Sep 07 15:57:49.292210 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 128/245] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:49 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:49.314495 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3a35010a-4793-4365-b6fa-ed77d1c3a2c2 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:49.315103 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3a35010a-4793-4365-b6fa-ed77d1c3a2c2 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:49.324330 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3a35010a-4793-4365-b6fa-ed77d1c3a2c2 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:49.324830 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3a35010a-4793-4365-b6fa-ed77d1c3a2c2 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:49.325270 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3a35010a-4793-4365-b6fa-ed77d1c3a2c2 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:49.325965 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3a35010a-4793-4365-b6fa-ed77d1c3a2c2 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:49.326419 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3a35010a-4793-4365-b6fa-ed77d1c3a2c2 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:49.326843 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3a35010a-4793-4365-b6fa-ed77d1c3a2c2 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:49.465518 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-3a35010a-4793-4365-b6fa-ed77d1c3a2c2 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:49.475424 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3a35010a-4793-4365-b6fa-ed77d1c3a2c2 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1554 microversion: 2.1 time: 0.164635 Sep 07 15:57:49.476855 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 118/246] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:49 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1554 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:49.676504 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6015f6a7-c145-4b8c-8c10-fa2c649b3bfd tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:49.677111 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6015f6a7-c145-4b8c-8c10-fa2c649b3bfd tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] [instance: af97f825-9004-4c4d-a0da-479b2465b189] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:49.682851 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6015f6a7-c145-4b8c-8c10-fa2c649b3bfd tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:49.683329 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6015f6a7-c145-4b8c-8c10-fa2c649b3bfd tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:49.683846 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6015f6a7-c145-4b8c-8c10-fa2c649b3bfd tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:49.684546 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6015f6a7-c145-4b8c-8c10-fa2c649b3bfd tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:49.685015 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6015f6a7-c145-4b8c-8c10-fa2c649b3bfd tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:49.685440 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6015f6a7-c145-4b8c-8c10-fa2c649b3bfd tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:49.703930 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:49.821374 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6015f6a7-c145-4b8c-8c10-fa2c649b3bfd tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a393cb6b2343d697ec2e87d750c70a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf52e3718140d1b2e4883f8d5464f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:49.829490 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6015f6a7-c145-4b8c-8c10-fa2c649b3bfd tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] 10.222.0.17 "GET /compute/v2.1/servers/af97f825-9004-4c4d-a0da-479b2465b189" status: 200 len: 1313 microversion: 2.1 time: 0.157080 Sep 07 15:57:49.830059 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 129/247] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:49 2022] GET /compute/v2.1/servers/af97f825-9004-4c4d-a0da-479b2465b189 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:57:50.315487 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d90e3b0d-eda1-462c-ab53-25866382a42f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:50.316134 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d90e3b0d-eda1-462c-ab53-25866382a42f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:50.323170 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d90e3b0d-eda1-462c-ab53-25866382a42f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:50.323621 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d90e3b0d-eda1-462c-ab53-25866382a42f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:50.324130 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d90e3b0d-eda1-462c-ab53-25866382a42f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:50.324846 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d90e3b0d-eda1-462c-ab53-25866382a42f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:50.325324 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d90e3b0d-eda1-462c-ab53-25866382a42f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:50.325805 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d90e3b0d-eda1-462c-ab53-25866382a42f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:50.466456 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-d90e3b0d-eda1-462c-ab53-25866382a42f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:50.474212 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d90e3b0d-eda1-462c-ab53-25866382a42f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1522 microversion: 2.1 time: 0.163377 Sep 07 15:57:50.474776 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 119/248] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:50 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:50.499216 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fa312ef1-daa2-4f07-abb7-ba023ff142e5 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:50.499912 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fa312ef1-daa2-4f07-abb7-ba023ff142e5 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:50.506542 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa312ef1-daa2-4f07-abb7-ba023ff142e5 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:50.507033 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa312ef1-daa2-4f07-abb7-ba023ff142e5 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:50.507468 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa312ef1-daa2-4f07-abb7-ba023ff142e5 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:50.508189 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa312ef1-daa2-4f07-abb7-ba023ff142e5 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:50.508646 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa312ef1-daa2-4f07-abb7-ba023ff142e5 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:50.509073 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa312ef1-daa2-4f07-abb7-ba023ff142e5 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:50.646699 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-fa312ef1-daa2-4f07-abb7-ba023ff142e5 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:50.655510 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fa312ef1-daa2-4f07-abb7-ba023ff142e5 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1554 microversion: 2.1 time: 0.160159 Sep 07 15:57:50.656709 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 130/249] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:50 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:50.853439 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a5577cab-ea7f-4ac3-a91b-ebc863c06061 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:50.854076 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a5577cab-ea7f-4ac3-a91b-ebc863c06061 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] [instance: af97f825-9004-4c4d-a0da-479b2465b189] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:50.860546 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5577cab-ea7f-4ac3-a91b-ebc863c06061 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:50.861099 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5577cab-ea7f-4ac3-a91b-ebc863c06061 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:50.861602 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5577cab-ea7f-4ac3-a91b-ebc863c06061 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:50.862358 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5577cab-ea7f-4ac3-a91b-ebc863c06061 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:50.862881 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5577cab-ea7f-4ac3-a91b-ebc863c06061 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:50.863413 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5577cab-ea7f-4ac3-a91b-ebc863c06061 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:50.997259 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-a5577cab-ea7f-4ac3-a91b-ebc863c06061 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a393cb6b2343d697ec2e87d750c70a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf52e3718140d1b2e4883f8d5464f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:51.011502 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a5577cab-ea7f-4ac3-a91b-ebc863c06061 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] 10.222.0.17 "GET /compute/v2.1/servers/af97f825-9004-4c4d-a0da-479b2465b189" status: 200 len: 1313 microversion: 2.1 time: 0.162135 Sep 07 15:57:51.012185 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 120/250] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:50 2022] GET /compute/v2.1/servers/af97f825-9004-4c4d-a0da-479b2465b189 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:51.497566 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0a1989f4-de5a-482d-9b8b-533a616dfa44 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:51.498269 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0a1989f4-de5a-482d-9b8b-533a616dfa44 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:51.500744 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:51.502276 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=6 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:51.507886 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0a1989f4-de5a-482d-9b8b-533a616dfa44 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:51.508420 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0a1989f4-de5a-482d-9b8b-533a616dfa44 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:51.508857 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0a1989f4-de5a-482d-9b8b-533a616dfa44 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:51.509553 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0a1989f4-de5a-482d-9b8b-533a616dfa44 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:51.510005 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0a1989f4-de5a-482d-9b8b-533a616dfa44 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:51.510426 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0a1989f4-de5a-482d-9b8b-533a616dfa44 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:51.655420 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-0a1989f4-de5a-482d-9b8b-533a616dfa44 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:51.663859 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0a1989f4-de5a-482d-9b8b-533a616dfa44 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1522 microversion: 2.1 time: 0.170180 Sep 07 15:57:51.668242 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 131/251] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:51 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:51.684952 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2f961d54-8c10-45c2-bc59-92cf13ed515c tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:51.685751 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2f961d54-8c10-45c2-bc59-92cf13ed515c tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:51.689292 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:51.701215 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f961d54-8c10-45c2-bc59-92cf13ed515c tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:51.704056 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f961d54-8c10-45c2-bc59-92cf13ed515c tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:51.704371 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f961d54-8c10-45c2-bc59-92cf13ed515c tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:51.705074 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f961d54-8c10-45c2-bc59-92cf13ed515c tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:51.705531 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f961d54-8c10-45c2-bc59-92cf13ed515c tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:51.705954 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f961d54-8c10-45c2-bc59-92cf13ed515c tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:52.016772 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-2f961d54-8c10-45c2-bc59-92cf13ed515c tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:52.024844 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2f961d54-8c10-45c2-bc59-92cf13ed515c tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1554 microversion: 2.1 time: 0.348788 Sep 07 15:57:52.025412 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 121/252] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:51 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1554 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:52.040172 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5b5c7a96-b006-4228-977a-94cce95ece1e tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:52.040803 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5b5c7a96-b006-4228-977a-94cce95ece1e tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] [instance: af97f825-9004-4c4d-a0da-479b2465b189] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:52.047473 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b5c7a96-b006-4228-977a-94cce95ece1e tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:52.047994 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b5c7a96-b006-4228-977a-94cce95ece1e tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:52.048444 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b5c7a96-b006-4228-977a-94cce95ece1e tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:52.049094 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b5c7a96-b006-4228-977a-94cce95ece1e tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:52.049717 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b5c7a96-b006-4228-977a-94cce95ece1e tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:52.050171 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b5c7a96-b006-4228-977a-94cce95ece1e tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:52.221069 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5b5c7a96-b006-4228-977a-94cce95ece1e tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a393cb6b2343d697ec2e87d750c70a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf52e3718140d1b2e4883f8d5464f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:52.228903 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5b5c7a96-b006-4228-977a-94cce95ece1e tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] 10.222.0.17 "GET /compute/v2.1/servers/af97f825-9004-4c4d-a0da-479b2465b189" status: 200 len: 1313 microversion: 2.1 time: 0.192493 Sep 07 15:57:52.229655 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 132/253] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:52 2022] GET /compute/v2.1/servers/af97f825-9004-4c4d-a0da-479b2465b189 => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:52.688319 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3812d1ed-96a1-4368-8b7a-4dc85a527b4d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:52.688934 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3812d1ed-96a1-4368-8b7a-4dc85a527b4d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:52.695658 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3812d1ed-96a1-4368-8b7a-4dc85a527b4d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:52.696151 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3812d1ed-96a1-4368-8b7a-4dc85a527b4d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:52.696587 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3812d1ed-96a1-4368-8b7a-4dc85a527b4d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:52.697336 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3812d1ed-96a1-4368-8b7a-4dc85a527b4d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:52.697796 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3812d1ed-96a1-4368-8b7a-4dc85a527b4d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:52.698221 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3812d1ed-96a1-4368-8b7a-4dc85a527b4d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:52.882825 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-3812d1ed-96a1-4368-8b7a-4dc85a527b4d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:52.891371 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3812d1ed-96a1-4368-8b7a-4dc85a527b4d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1522 microversion: 2.1 time: 0.207038 Sep 07 15:57:52.891967 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 122/254] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:52 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:53.048256 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c6dde54a-f5a0-4cf4-b75a-04fd65268f30 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:53.048873 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c6dde54a-f5a0-4cf4-b75a-04fd65268f30 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:53.055400 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6dde54a-f5a0-4cf4-b75a-04fd65268f30 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:53.055902 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6dde54a-f5a0-4cf4-b75a-04fd65268f30 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:53.056345 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6dde54a-f5a0-4cf4-b75a-04fd65268f30 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:53.057023 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6dde54a-f5a0-4cf4-b75a-04fd65268f30 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:53.057649 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6dde54a-f5a0-4cf4-b75a-04fd65268f30 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:53.058223 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6dde54a-f5a0-4cf4-b75a-04fd65268f30 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:53.205229 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c6dde54a-f5a0-4cf4-b75a-04fd65268f30 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:53.215693 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c6dde54a-f5a0-4cf4-b75a-04fd65268f30 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1554 microversion: 2.1 time: 0.172208 Sep 07 15:57:53.216597 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 133/255] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:53 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1554 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:53.252279 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-86dc148d-3ba2-4049-affd-dddcf094e7c9 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:53.253389 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-86dc148d-3ba2-4049-affd-dddcf094e7c9 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] [instance: af97f825-9004-4c4d-a0da-479b2465b189] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:53.263248 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86dc148d-3ba2-4049-affd-dddcf094e7c9 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:53.263773 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86dc148d-3ba2-4049-affd-dddcf094e7c9 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:53.264207 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86dc148d-3ba2-4049-affd-dddcf094e7c9 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:53.264887 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86dc148d-3ba2-4049-affd-dddcf094e7c9 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:53.266201 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86dc148d-3ba2-4049-affd-dddcf094e7c9 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:53.266625 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86dc148d-3ba2-4049-affd-dddcf094e7c9 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:53.404480 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-86dc148d-3ba2-4049-affd-dddcf094e7c9 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a393cb6b2343d697ec2e87d750c70a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf52e3718140d1b2e4883f8d5464f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:53.412151 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-86dc148d-3ba2-4049-affd-dddcf094e7c9 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] 10.222.0.17 "GET /compute/v2.1/servers/af97f825-9004-4c4d-a0da-479b2465b189" status: 200 len: 1313 microversion: 2.1 time: 0.163778 Sep 07 15:57:53.412700 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 123/256] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:53 2022] GET /compute/v2.1/servers/af97f825-9004-4c4d-a0da-479b2465b189 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:53.913933 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c448f706-d3b5-46c8-8a1a-3290e61105ff tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:53.914541 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c448f706-d3b5-46c8-8a1a-3290e61105ff tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:53.920611 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c448f706-d3b5-46c8-8a1a-3290e61105ff tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:53.921099 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c448f706-d3b5-46c8-8a1a-3290e61105ff tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:53.921579 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c448f706-d3b5-46c8-8a1a-3290e61105ff tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:53.922272 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c448f706-d3b5-46c8-8a1a-3290e61105ff tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:53.922728 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c448f706-d3b5-46c8-8a1a-3290e61105ff tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:53.923158 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c448f706-d3b5-46c8-8a1a-3290e61105ff tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:54.061116 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c448f706-d3b5-46c8-8a1a-3290e61105ff tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:54.069533 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c448f706-d3b5-46c8-8a1a-3290e61105ff tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1522 microversion: 2.1 time: 0.159361 Sep 07 15:57:54.070104 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 134/257] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:53 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:54.243439 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bcb132da-4738-4b75-b4b7-77828c937ad4 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:54.244084 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bcb132da-4738-4b75-b4b7-77828c937ad4 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:54.262304 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bcb132da-4738-4b75-b4b7-77828c937ad4 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:54.263077 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bcb132da-4738-4b75-b4b7-77828c937ad4 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:54.263742 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bcb132da-4738-4b75-b4b7-77828c937ad4 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:54.264700 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bcb132da-4738-4b75-b4b7-77828c937ad4 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:54.265570 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bcb132da-4738-4b75-b4b7-77828c937ad4 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:54.266163 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bcb132da-4738-4b75-b4b7-77828c937ad4 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:54.435735 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cf2b7d13-e3d1-4887-8043-9ec09f336c9c tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:54.436341 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cf2b7d13-e3d1-4887-8043-9ec09f336c9c tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] [instance: af97f825-9004-4c4d-a0da-479b2465b189] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:54.444471 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf2b7d13-e3d1-4887-8043-9ec09f336c9c tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:54.444960 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf2b7d13-e3d1-4887-8043-9ec09f336c9c tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:54.445434 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-bcb132da-4738-4b75-b4b7-77828c937ad4 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:54.445809 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf2b7d13-e3d1-4887-8043-9ec09f336c9c tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:54.446686 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf2b7d13-e3d1-4887-8043-9ec09f336c9c tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:54.447147 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf2b7d13-e3d1-4887-8043-9ec09f336c9c tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:54.447600 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cf2b7d13-e3d1-4887-8043-9ec09f336c9c tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:54.454039 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bcb132da-4738-4b75-b4b7-77828c937ad4 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1554 microversion: 2.1 time: 0.214477 Sep 07 15:57:54.454539 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 124/258] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:54 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1554 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:54.587083 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-cf2b7d13-e3d1-4887-8043-9ec09f336c9c tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a393cb6b2343d697ec2e87d750c70a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf52e3718140d1b2e4883f8d5464f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:54.595591 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cf2b7d13-e3d1-4887-8043-9ec09f336c9c tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] 10.222.0.17 "GET /compute/v2.1/servers/af97f825-9004-4c4d-a0da-479b2465b189" status: 200 len: 1313 microversion: 2.1 time: 0.163704 Sep 07 15:57:54.596166 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 135/259] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:54 2022] GET /compute/v2.1/servers/af97f825-9004-4c4d-a0da-479b2465b189 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:55.101199 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-957fb712-7191-4dbf-8e7a-8bbf4e7ba569 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:55.101813 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-957fb712-7191-4dbf-8e7a-8bbf4e7ba569 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:55.107621 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-957fb712-7191-4dbf-8e7a-8bbf4e7ba569 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:55.108105 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-957fb712-7191-4dbf-8e7a-8bbf4e7ba569 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:55.108538 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-957fb712-7191-4dbf-8e7a-8bbf4e7ba569 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:55.109869 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-957fb712-7191-4dbf-8e7a-8bbf4e7ba569 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:55.110322 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-957fb712-7191-4dbf-8e7a-8bbf4e7ba569 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:55.110747 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-957fb712-7191-4dbf-8e7a-8bbf4e7ba569 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:55.245631 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-957fb712-7191-4dbf-8e7a-8bbf4e7ba569 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:55.253389 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-957fb712-7191-4dbf-8e7a-8bbf4e7ba569 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1522 microversion: 2.1 time: 0.156209 Sep 07 15:57:55.253958 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 125/260] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:55 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:55.440523 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-ffc71b13-54b8-44ae-bc76-aa9408970804 req-0d355c5e-d93f-438d-a74b-5045711cbbb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af97f825-9004-4c4d-a0da-479b2465b189", "name": "network-vif-plugged", "status": "completed", "tag": "30b26de7-eda7-43df-a617-41c604f06a9a"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:57:55.449815 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ffc71b13-54b8-44ae-bc76-aa9408970804 req-0d355c5e-d93f-438d-a74b-5045711cbbb7 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:55.450274 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ffc71b13-54b8-44ae-bc76-aa9408970804 req-0d355c5e-d93f-438d-a74b-5045711cbbb7 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:55.450693 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-ffc71b13-54b8-44ae-bc76-aa9408970804 req-0d355c5e-d93f-438d-a74b-5045711cbbb7 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:55.461841 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-ffc71b13-54b8-44ae-bc76-aa9408970804 req-0d355c5e-d93f-438d-a74b-5045711cbbb7 service nova] Creating event network-vif-plugged:30b26de7-eda7-43df-a617-41c604f06a9a for instance af97f825-9004-4c4d-a0da-479b2465b189 on hv-cinder-85331 Sep 07 15:57:55.466777 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-ffc71b13-54b8-44ae-bc76-aa9408970804 req-0d355c5e-d93f-438d-a74b-5045711cbbb7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029949 Sep 07 15:57:55.467357 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 136/261] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 15:57:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:57:55.478359 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-89b3fbce-abba-419a-b541-0f4be8c97b95 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:55.479071 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-89b3fbce-abba-419a-b541-0f4be8c97b95 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:55.486218 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89b3fbce-abba-419a-b541-0f4be8c97b95 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:55.486770 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89b3fbce-abba-419a-b541-0f4be8c97b95 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:55.487312 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89b3fbce-abba-419a-b541-0f4be8c97b95 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:55.488111 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89b3fbce-abba-419a-b541-0f4be8c97b95 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:55.488655 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89b3fbce-abba-419a-b541-0f4be8c97b95 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:55.489217 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89b3fbce-abba-419a-b541-0f4be8c97b95 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:55.617095 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-89b3fbce-abba-419a-b541-0f4be8c97b95 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:55.618685 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d23db7b3-83c4-4418-964e-7854afeef28d tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:55.619379 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d23db7b3-83c4-4418-964e-7854afeef28d tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] [instance: af97f825-9004-4c4d-a0da-479b2465b189] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:55.619477 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:55.625846 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d23db7b3-83c4-4418-964e-7854afeef28d tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:55.626346 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d23db7b3-83c4-4418-964e-7854afeef28d tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:55.626764 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d23db7b3-83c4-4418-964e-7854afeef28d tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:55.627449 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d23db7b3-83c4-4418-964e-7854afeef28d tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:55.627936 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d23db7b3-83c4-4418-964e-7854afeef28d tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:55.628140 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-89b3fbce-abba-419a-b541-0f4be8c97b95 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1554 microversion: 2.1 time: 0.154328 Sep 07 15:57:55.628358 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d23db7b3-83c4-4418-964e-7854afeef28d tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:55.628849 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 126/262] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:55 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:55.757125 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d23db7b3-83c4-4418-964e-7854afeef28d tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a393cb6b2343d697ec2e87d750c70a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf52e3718140d1b2e4883f8d5464f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:55.764737 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d23db7b3-83c4-4418-964e-7854afeef28d tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] 10.222.0.17 "GET /compute/v2.1/servers/af97f825-9004-4c4d-a0da-479b2465b189" status: 200 len: 1313 microversion: 2.1 time: 0.150263 Sep 07 15:57:55.765786 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 137/263] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:55 2022] GET /compute/v2.1/servers/af97f825-9004-4c4d-a0da-479b2465b189 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:57:56.276271 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2b41fc5d-8239-45b2-9bed-cac1fea331b0 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:56.276876 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2b41fc5d-8239-45b2-9bed-cac1fea331b0 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:56.283962 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b41fc5d-8239-45b2-9bed-cac1fea331b0 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:56.284440 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b41fc5d-8239-45b2-9bed-cac1fea331b0 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:56.284869 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b41fc5d-8239-45b2-9bed-cac1fea331b0 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:56.285551 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b41fc5d-8239-45b2-9bed-cac1fea331b0 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:56.286000 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b41fc5d-8239-45b2-9bed-cac1fea331b0 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:56.286419 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b41fc5d-8239-45b2-9bed-cac1fea331b0 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:56.418067 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-2b41fc5d-8239-45b2-9bed-cac1fea331b0 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:56.428469 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2b41fc5d-8239-45b2-9bed-cac1fea331b0 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1522 microversion: 2.1 time: 0.156089 Sep 07 15:57:56.429043 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 127/264] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:56 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:57:56.651685 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3f549eaa-cff6-4b5b-a575-88851cf9cd37 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:56.652193 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3f549eaa-cff6-4b5b-a575-88851cf9cd37 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:56.658617 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f549eaa-cff6-4b5b-a575-88851cf9cd37 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:56.659080 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f549eaa-cff6-4b5b-a575-88851cf9cd37 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:56.659507 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f549eaa-cff6-4b5b-a575-88851cf9cd37 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:56.660217 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f549eaa-cff6-4b5b-a575-88851cf9cd37 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:56.660657 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f549eaa-cff6-4b5b-a575-88851cf9cd37 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:56.661073 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3f549eaa-cff6-4b5b-a575-88851cf9cd37 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:56.788763 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b3f826fb-c8e9-4794-84f4-f287e6a5a306 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:56.789370 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b3f826fb-c8e9-4794-84f4-f287e6a5a306 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] [instance: af97f825-9004-4c4d-a0da-479b2465b189] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:56.792912 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3f549eaa-cff6-4b5b-a575-88851cf9cd37 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:56.801074 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b3f826fb-c8e9-4794-84f4-f287e6a5a306 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:56.801987 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b3f826fb-c8e9-4794-84f4-f287e6a5a306 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:56.802725 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b3f826fb-c8e9-4794-84f4-f287e6a5a306 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:56.803753 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b3f826fb-c8e9-4794-84f4-f287e6a5a306 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:56.804495 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b3f826fb-c8e9-4794-84f4-f287e6a5a306 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:56.805229 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b3f826fb-c8e9-4794-84f4-f287e6a5a306 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:56.810324 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3f549eaa-cff6-4b5b-a575-88851cf9cd37 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1554 microversion: 2.1 time: 0.162302 Sep 07 15:57:56.811176 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 138/265] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:56 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:56.929974 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-b3f826fb-c8e9-4794-84f4-f287e6a5a306 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a393cb6b2343d697ec2e87d750c70a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf52e3718140d1b2e4883f8d5464f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:56.937475 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b3f826fb-c8e9-4794-84f4-f287e6a5a306 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] 10.222.0.17 "GET /compute/v2.1/servers/af97f825-9004-4c4d-a0da-479b2465b189" status: 200 len: 1313 microversion: 2.1 time: 0.153040 Sep 07 15:57:56.938041 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 128/266] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:56 2022] GET /compute/v2.1/servers/af97f825-9004-4c4d-a0da-479b2465b189 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:57.452003 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-17329727-9fd1-49ff-ad4e-05874b14fe1e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:57.453185 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-17329727-9fd1-49ff-ad4e-05874b14fe1e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:57.459869 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17329727-9fd1-49ff-ad4e-05874b14fe1e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:57.460355 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17329727-9fd1-49ff-ad4e-05874b14fe1e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:57.460785 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17329727-9fd1-49ff-ad4e-05874b14fe1e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:57.461472 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17329727-9fd1-49ff-ad4e-05874b14fe1e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:57.461920 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17329727-9fd1-49ff-ad4e-05874b14fe1e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:57.462341 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-17329727-9fd1-49ff-ad4e-05874b14fe1e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:57.592567 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-17329727-9fd1-49ff-ad4e-05874b14fe1e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:57.600281 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-17329727-9fd1-49ff-ad4e-05874b14fe1e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1522 microversion: 2.1 time: 0.152025 Sep 07 15:57:57.601089 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 139/267] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:57 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:57.836291 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e9e8b933-709a-419a-b39b-3c85181368d8 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:57.836926 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e9e8b933-709a-419a-b39b-3c85181368d8 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:57.843384 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e9e8b933-709a-419a-b39b-3c85181368d8 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:57.843902 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e9e8b933-709a-419a-b39b-3c85181368d8 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:57.844363 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e9e8b933-709a-419a-b39b-3c85181368d8 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:57.845051 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e9e8b933-709a-419a-b39b-3c85181368d8 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:57.845512 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e9e8b933-709a-419a-b39b-3c85181368d8 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:57.845939 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e9e8b933-709a-419a-b39b-3c85181368d8 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:57.960152 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ab4f92e4-7c60-4404-a8f9-4de2be83a318 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:57.960858 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ab4f92e4-7c60-4404-a8f9-4de2be83a318 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] [instance: af97f825-9004-4c4d-a0da-479b2465b189] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:57.966835 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab4f92e4-7c60-4404-a8f9-4de2be83a318 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:57.967257 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab4f92e4-7c60-4404-a8f9-4de2be83a318 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:57.967721 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab4f92e4-7c60-4404-a8f9-4de2be83a318 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:57.968617 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab4f92e4-7c60-4404-a8f9-4de2be83a318 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:57.969224 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab4f92e4-7c60-4404-a8f9-4de2be83a318 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:57.969719 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab4f92e4-7c60-4404-a8f9-4de2be83a318 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:57.974824 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-e9e8b933-709a-419a-b39b-3c85181368d8 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:57.992302 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e9e8b933-709a-419a-b39b-3c85181368d8 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1554 microversion: 2.1 time: 0.153794 Sep 07 15:57:57.992302 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 129/268] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:57 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:58.133661 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ab4f92e4-7c60-4404-a8f9-4de2be83a318 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a393cb6b2343d697ec2e87d750c70a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf52e3718140d1b2e4883f8d5464f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:58.141767 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ab4f92e4-7c60-4404-a8f9-4de2be83a318 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] 10.222.0.17 "GET /compute/v2.1/servers/af97f825-9004-4c4d-a0da-479b2465b189" status: 200 len: 1313 microversion: 2.1 time: 0.185515 Sep 07 15:57:58.142650 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 140/269] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:57 2022] GET /compute/v2.1/servers/af97f825-9004-4c4d-a0da-479b2465b189 => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:57:58.623386 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-aa8e8ede-a3eb-4149-aed6-805e703cc1e6 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:58.624052 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-aa8e8ede-a3eb-4149-aed6-805e703cc1e6 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:58.630328 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aa8e8ede-a3eb-4149-aed6-805e703cc1e6 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:58.630813 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aa8e8ede-a3eb-4149-aed6-805e703cc1e6 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:58.631248 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aa8e8ede-a3eb-4149-aed6-805e703cc1e6 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:58.631969 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aa8e8ede-a3eb-4149-aed6-805e703cc1e6 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:58.632427 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aa8e8ede-a3eb-4149-aed6-805e703cc1e6 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:58.632847 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aa8e8ede-a3eb-4149-aed6-805e703cc1e6 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:58.767092 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-aa8e8ede-a3eb-4149-aed6-805e703cc1e6 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:58.774639 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-aa8e8ede-a3eb-4149-aed6-805e703cc1e6 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1522 microversion: 2.1 time: 0.155073 Sep 07 15:57:58.775229 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 130/270] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:58 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:59.013952 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e005ce4d-1467-4bb1-b0c5-5fd79c14f274 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:59.014559 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e005ce4d-1467-4bb1-b0c5-5fd79c14f274 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:59.021001 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e005ce4d-1467-4bb1-b0c5-5fd79c14f274 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:59.021477 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e005ce4d-1467-4bb1-b0c5-5fd79c14f274 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:59.021915 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e005ce4d-1467-4bb1-b0c5-5fd79c14f274 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:59.022594 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e005ce4d-1467-4bb1-b0c5-5fd79c14f274 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:59.023041 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e005ce4d-1467-4bb1-b0c5-5fd79c14f274 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:59.023463 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e005ce4d-1467-4bb1-b0c5-5fd79c14f274 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:59.165000 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5ce703c2-e2ee-43e2-aa0c-7e3e3e229aaa tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:59.165681 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5ce703c2-e2ee-43e2-aa0c-7e3e3e229aaa tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] [instance: af97f825-9004-4c4d-a0da-479b2465b189] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:59.179531 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5ce703c2-e2ee-43e2-aa0c-7e3e3e229aaa tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:59.180254 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5ce703c2-e2ee-43e2-aa0c-7e3e3e229aaa tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:59.180694 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5ce703c2-e2ee-43e2-aa0c-7e3e3e229aaa tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:59.181479 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5ce703c2-e2ee-43e2-aa0c-7e3e3e229aaa tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:59.181933 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5ce703c2-e2ee-43e2-aa0c-7e3e3e229aaa tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:59.182383 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5ce703c2-e2ee-43e2-aa0c-7e3e3e229aaa tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:59.239038 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e005ce4d-1467-4bb1-b0c5-5fd79c14f274 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:59.248359 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e005ce4d-1467-4bb1-b0c5-5fd79c14f274 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1554 microversion: 2.1 time: 0.238207 Sep 07 15:57:59.264379 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 141/271] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:59 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1554 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:59.324234 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-5ce703c2-e2ee-43e2-aa0c-7e3e3e229aaa tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a393cb6b2343d697ec2e87d750c70a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf52e3718140d1b2e4883f8d5464f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:59.331833 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5ce703c2-e2ee-43e2-aa0c-7e3e3e229aaa tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] 10.222.0.17 "GET /compute/v2.1/servers/af97f825-9004-4c4d-a0da-479b2465b189" status: 200 len: 1313 microversion: 2.1 time: 0.170543 Sep 07 15:57:59.332397 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 131/272] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:59 2022] GET /compute/v2.1/servers/af97f825-9004-4c4d-a0da-479b2465b189 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:57:59.708202 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-99257ba5-e4d2-4acc-8b49-f92422d72c30 req-515b5c69-fcf3-48ae-8a01-8d42e9298c19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "881d1d65-f44f-40d2-9e0e-01f29e5bd88a", "name": "network-vif-deleted", "tag": "ae90bf0e-889b-437f-8ebd-f3878af5201c"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:57:59.717748 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-99257ba5-e4d2-4acc-8b49-f92422d72c30 req-515b5c69-fcf3-48ae-8a01-8d42e9298c19 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:59.718773 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-99257ba5-e4d2-4acc-8b49-f92422d72c30 req-515b5c69-fcf3-48ae-8a01-8d42e9298c19 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:59.719199 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-99257ba5-e4d2-4acc-8b49-f92422d72c30 req-515b5c69-fcf3-48ae-8a01-8d42e9298c19 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:59.731472 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-99257ba5-e4d2-4acc-8b49-f92422d72c30 req-515b5c69-fcf3-48ae-8a01-8d42e9298c19 service nova] Creating event network-vif-deleted:ae90bf0e-889b-437f-8ebd-f3878af5201c for instance 881d1d65-f44f-40d2-9e0e-01f29e5bd88a on hv-cinder-85331 Sep 07 15:57:59.737113 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-99257ba5-e4d2-4acc-8b49-f92422d72c30 req-515b5c69-fcf3-48ae-8a01-8d42e9298c19 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032555 Sep 07 15:57:59.737708 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 142/273] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 15:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:57:59.799246 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ec9cade2-0e46-45bc-b2fa-f9acb922c7c5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:57:59.799864 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ec9cade2-0e46-45bc-b2fa-f9acb922c7c5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:57:59.805790 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ec9cade2-0e46-45bc-b2fa-f9acb922c7c5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:59.806274 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ec9cade2-0e46-45bc-b2fa-f9acb922c7c5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:59.806709 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ec9cade2-0e46-45bc-b2fa-f9acb922c7c5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:59.807396 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ec9cade2-0e46-45bc-b2fa-f9acb922c7c5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:57:59.807878 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ec9cade2-0e46-45bc-b2fa-f9acb922c7c5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:57:59.808307 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ec9cade2-0e46-45bc-b2fa-f9acb922c7c5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:57:59.944853 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-ec9cade2-0e46-45bc-b2fa-f9acb922c7c5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:57:59.952424 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ec9cade2-0e46-45bc-b2fa-f9acb922c7c5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1522 microversion: 2.1 time: 0.158104 Sep 07 15:57:59.952978 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 132/274] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:57:59 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:00.272385 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-44639c91-3dc7-4041-a463-cb6d671842a4 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:00.273062 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-44639c91-3dc7-4041-a463-cb6d671842a4 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:00.279136 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44639c91-3dc7-4041-a463-cb6d671842a4 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:00.279642 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44639c91-3dc7-4041-a463-cb6d671842a4 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:00.280069 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44639c91-3dc7-4041-a463-cb6d671842a4 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:00.281387 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44639c91-3dc7-4041-a463-cb6d671842a4 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:00.281858 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44639c91-3dc7-4041-a463-cb6d671842a4 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:00.282278 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44639c91-3dc7-4041-a463-cb6d671842a4 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:00.345316 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-44639c91-3dc7-4041-a463-cb6d671842a4 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:00.354161 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-44639c91-3dc7-4041-a463-cb6d671842a4 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1346 microversion: 2.1 time: 0.086061 Sep 07 15:58:00.354729 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 143/275] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:00 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1346 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:00.359636 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-42bae0de-78e0-4a77-8000-e48d2e7d6ff4 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:00.360649 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-42bae0de-78e0-4a77-8000-e48d2e7d6ff4 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] [instance: af97f825-9004-4c4d-a0da-479b2465b189] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:00.368488 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-42bae0de-78e0-4a77-8000-e48d2e7d6ff4 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:00.368974 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-42bae0de-78e0-4a77-8000-e48d2e7d6ff4 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:00.369411 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-42bae0de-78e0-4a77-8000-e48d2e7d6ff4 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:00.370130 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-42bae0de-78e0-4a77-8000-e48d2e7d6ff4 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:00.370588 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-42bae0de-78e0-4a77-8000-e48d2e7d6ff4 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:00.371014 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-42bae0de-78e0-4a77-8000-e48d2e7d6ff4 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:00.502014 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-42bae0de-78e0-4a77-8000-e48d2e7d6ff4 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a393cb6b2343d697ec2e87d750c70a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf52e3718140d1b2e4883f8d5464f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:00.509774 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-42bae0de-78e0-4a77-8000-e48d2e7d6ff4 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] 10.222.0.17 "GET /compute/v2.1/servers/af97f825-9004-4c4d-a0da-479b2465b189" status: 200 len: 1313 microversion: 2.1 time: 0.157130 Sep 07 15:58:00.510333 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 133/276] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:00 2022] GET /compute/v2.1/servers/af97f825-9004-4c4d-a0da-479b2465b189 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:00.974237 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0262d837-e824-47ef-890b-1e2c66491dcd tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:00.974798 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0262d837-e824-47ef-890b-1e2c66491dcd tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:00.981176 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0262d837-e824-47ef-890b-1e2c66491dcd tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:00.981679 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0262d837-e824-47ef-890b-1e2c66491dcd tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:00.982115 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0262d837-e824-47ef-890b-1e2c66491dcd tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:00.982803 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0262d837-e824-47ef-890b-1e2c66491dcd tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:00.983258 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0262d837-e824-47ef-890b-1e2c66491dcd tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:00.984245 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0262d837-e824-47ef-890b-1e2c66491dcd tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:01.117549 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-0262d837-e824-47ef-890b-1e2c66491dcd tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:01.125341 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0262d837-e824-47ef-890b-1e2c66491dcd tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1522 microversion: 2.1 time: 0.154983 Sep 07 15:58:01.125902 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 144/277] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:00 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:01.375843 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d5adf381-e1b3-44ad-9654-c8bf0e8bf535 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:01.376739 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d5adf381-e1b3-44ad-9654-c8bf0e8bf535 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:01.379206 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:01.384620 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d5adf381-e1b3-44ad-9654-c8bf0e8bf535 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:01.385105 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d5adf381-e1b3-44ad-9654-c8bf0e8bf535 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:01.385550 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d5adf381-e1b3-44ad-9654-c8bf0e8bf535 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:01.386246 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d5adf381-e1b3-44ad-9654-c8bf0e8bf535 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:01.386704 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d5adf381-e1b3-44ad-9654-c8bf0e8bf535 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:01.387133 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d5adf381-e1b3-44ad-9654-c8bf0e8bf535 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:01.450844 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-d5adf381-e1b3-44ad-9654-c8bf0e8bf535 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:01.459022 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d5adf381-e1b3-44ad-9654-c8bf0e8bf535 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1346 microversion: 2.1 time: 0.087066 Sep 07 15:58:01.459597 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 134/278] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:01 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1346 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:01.532557 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fe14c1b5-3c9c-4fa6-82cc-efd0f372b708 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:01.533344 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fe14c1b5-3c9c-4fa6-82cc-efd0f372b708 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] [instance: af97f825-9004-4c4d-a0da-479b2465b189] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:01.539237 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fe14c1b5-3c9c-4fa6-82cc-efd0f372b708 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:01.539756 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fe14c1b5-3c9c-4fa6-82cc-efd0f372b708 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:01.540192 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fe14c1b5-3c9c-4fa6-82cc-efd0f372b708 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:01.540877 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fe14c1b5-3c9c-4fa6-82cc-efd0f372b708 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:01.541332 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fe14c1b5-3c9c-4fa6-82cc-efd0f372b708 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:01.541752 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fe14c1b5-3c9c-4fa6-82cc-efd0f372b708 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:01.696646 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-fe14c1b5-3c9c-4fa6-82cc-efd0f372b708 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a393cb6b2343d697ec2e87d750c70a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf52e3718140d1b2e4883f8d5464f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:01.706770 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fe14c1b5-3c9c-4fa6-82cc-efd0f372b708 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] 10.222.0.17 "GET /compute/v2.1/servers/af97f825-9004-4c4d-a0da-479b2465b189" status: 200 len: 1313 microversion: 2.1 time: 0.178551 Sep 07 15:58:01.711853 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 145/279] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:01 2022] GET /compute/v2.1/servers/af97f825-9004-4c4d-a0da-479b2465b189 => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:58:02.153775 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c1aa984d-48f7-41b0-98da-ad1b65fa1ec2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:02.154382 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c1aa984d-48f7-41b0-98da-ad1b65fa1ec2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:02.160357 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c1aa984d-48f7-41b0-98da-ad1b65fa1ec2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:02.160829 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c1aa984d-48f7-41b0-98da-ad1b65fa1ec2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:02.161259 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c1aa984d-48f7-41b0-98da-ad1b65fa1ec2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:02.161933 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c1aa984d-48f7-41b0-98da-ad1b65fa1ec2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:02.162378 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c1aa984d-48f7-41b0-98da-ad1b65fa1ec2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:02.162795 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c1aa984d-48f7-41b0-98da-ad1b65fa1ec2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:02.301624 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-c1aa984d-48f7-41b0-98da-ad1b65fa1ec2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:02.309277 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c1aa984d-48f7-41b0-98da-ad1b65fa1ec2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1522 microversion: 2.1 time: 0.159335 Sep 07 15:58:02.309837 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 135/280] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:02 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:02.483459 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e9c20cb4-b8a8-4478-a44f-ff7086587cd5 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:02.484096 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e9c20cb4-b8a8-4478-a44f-ff7086587cd5 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:02.490005 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9c20cb4-b8a8-4478-a44f-ff7086587cd5 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:02.490486 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9c20cb4-b8a8-4478-a44f-ff7086587cd5 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:02.490939 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9c20cb4-b8a8-4478-a44f-ff7086587cd5 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:02.491627 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9c20cb4-b8a8-4478-a44f-ff7086587cd5 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:02.492079 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9c20cb4-b8a8-4478-a44f-ff7086587cd5 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:02.492507 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e9c20cb4-b8a8-4478-a44f-ff7086587cd5 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:02.559064 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e9c20cb4-b8a8-4478-a44f-ff7086587cd5 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:02.567195 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e9c20cb4-b8a8-4478-a44f-ff7086587cd5 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1346 microversion: 2.1 time: 0.087572 Sep 07 15:58:02.567780 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 146/281] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:02 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1346 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:02.730762 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ad592d80-bd95-43ae-a8c7-9d3c1e53cede tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:02.731374 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ad592d80-bd95-43ae-a8c7-9d3c1e53cede tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] [instance: af97f825-9004-4c4d-a0da-479b2465b189] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:02.743929 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad592d80-bd95-43ae-a8c7-9d3c1e53cede tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:02.744546 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad592d80-bd95-43ae-a8c7-9d3c1e53cede tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:02.746017 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad592d80-bd95-43ae-a8c7-9d3c1e53cede tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:02.747054 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad592d80-bd95-43ae-a8c7-9d3c1e53cede tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:02.747589 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad592d80-bd95-43ae-a8c7-9d3c1e53cede tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:02.748051 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad592d80-bd95-43ae-a8c7-9d3c1e53cede tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:02.931186 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-ad592d80-bd95-43ae-a8c7-9d3c1e53cede tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a393cb6b2343d697ec2e87d750c70a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf52e3718140d1b2e4883f8d5464f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:02.940027 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ad592d80-bd95-43ae-a8c7-9d3c1e53cede tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] 10.222.0.17 "GET /compute/v2.1/servers/af97f825-9004-4c4d-a0da-479b2465b189" status: 200 len: 1498 microversion: 2.1 time: 0.213346 Sep 07 15:58:02.940726 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 136/282] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:02 2022] GET /compute/v2.1/servers/af97f825-9004-4c4d-a0da-479b2465b189 => generated 1498 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:03.333461 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-31822d54-24d7-4cd2-b7cb-760faa3f2e78 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:03.334096 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-31822d54-24d7-4cd2-b7cb-760faa3f2e78 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:03.337390 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:03.341651 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31822d54-24d7-4cd2-b7cb-760faa3f2e78 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:03.342135 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31822d54-24d7-4cd2-b7cb-760faa3f2e78 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:03.342559 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31822d54-24d7-4cd2-b7cb-760faa3f2e78 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:03.344161 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31822d54-24d7-4cd2-b7cb-760faa3f2e78 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:03.344613 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31822d54-24d7-4cd2-b7cb-760faa3f2e78 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:03.345169 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-31822d54-24d7-4cd2-b7cb-760faa3f2e78 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:03.365241 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:03.501793 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-31822d54-24d7-4cd2-b7cb-760faa3f2e78 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:03.510482 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-31822d54-24d7-4cd2-b7cb-760faa3f2e78 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1502 microversion: 2.1 time: 0.180702 Sep 07 15:58:03.511101 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 147/283] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:03 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1502 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:03.534868 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1434ceb9-cd2d-4618-b97f-d3123017a673 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:03.535676 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1434ceb9-cd2d-4618-b97f-d3123017a673 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: f39427e6-62a5-4a4e-96e8-644f03653722] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:03.541988 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1434ceb9-cd2d-4618-b97f-d3123017a673 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:03.542554 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1434ceb9-cd2d-4618-b97f-d3123017a673 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:03.543127 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1434ceb9-cd2d-4618-b97f-d3123017a673 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:03.543972 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1434ceb9-cd2d-4618-b97f-d3123017a673 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:03.544701 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1434ceb9-cd2d-4618-b97f-d3123017a673 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:03.545195 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1434ceb9-cd2d-4618-b97f-d3123017a673 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:03.591956 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bae56b90-de7a-43df-ac1b-d158c531edbb tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:03.592572 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bae56b90-de7a-43df-ac1b-d158c531edbb tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:03.598482 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bae56b90-de7a-43df-ac1b-d158c531edbb tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:03.598967 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bae56b90-de7a-43df-ac1b-d158c531edbb tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:03.599400 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bae56b90-de7a-43df-ac1b-d158c531edbb tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:03.600314 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bae56b90-de7a-43df-ac1b-d158c531edbb tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:03.611500 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bae56b90-de7a-43df-ac1b-d158c531edbb tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:03.612161 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bae56b90-de7a-43df-ac1b-d158c531edbb tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:03.652753 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bae56b90-de7a-43df-ac1b-d158c531edbb tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:03.653746 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bae56b90-de7a-43df-ac1b-d158c531edbb tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:03.654444 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bae56b90-de7a-43df-ac1b-d158c531edbb tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:03.655314 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-bae56b90-de7a-43df-ac1b-d158c531edbb tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lazy-loading 'fault' on Instance uuid 881d1d65-f44f-40d2-9e0e-01f29e5bd88a {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 15:58:03.713699 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-bae56b90-de7a-43df-ac1b-d158c531edbb tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:03.723211 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bae56b90-de7a-43df-ac1b-d158c531edbb tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1351 microversion: 2.1 time: 0.136527 Sep 07 15:58:03.724017 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 148/284] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:03 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1351 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:58:03.729053 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4cca77b1-ece0-422b-bca1-8e561fbe1e2f tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:03.729789 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4cca77b1-ece0-422b-bca1-8e561fbe1e2f tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] [instance: af97f825-9004-4c4d-a0da-479b2465b189] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:03.736978 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4cca77b1-ece0-422b-bca1-8e561fbe1e2f tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:03.737457 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4cca77b1-ece0-422b-bca1-8e561fbe1e2f tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:03.737880 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4cca77b1-ece0-422b-bca1-8e561fbe1e2f tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:03.738765 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4cca77b1-ece0-422b-bca1-8e561fbe1e2f tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:03.739420 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4cca77b1-ece0-422b-bca1-8e561fbe1e2f tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:03.739872 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4cca77b1-ece0-422b-bca1-8e561fbe1e2f tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:03.766383 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4cca77b1-ece0-422b-bca1-8e561fbe1e2f tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] [instance: af97f825-9004-4c4d-a0da-479b2465b189] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 15:58:03.767088 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-1434ceb9-cd2d-4618-b97f-d3123017a673 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:03.775205 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1434ceb9-cd2d-4618-b97f-d3123017a673 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722" status: 200 len: 1515 microversion: 2.1 time: 0.245179 Sep 07 15:58:03.775963 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 137/285] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:03 2022] GET /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722 => generated 1515 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:03.857516 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4cca77b1-ece0-422b-bca1-8e561fbe1e2f tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] 10.222.0.17 "DELETE /compute/v2.1/servers/af97f825-9004-4c4d-a0da-479b2465b189" status: 204 len: 0 microversion: 2.1 time: 0.131986 Sep 07 15:58:03.858532 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 149/286] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Sep 7 15:58:03 2022] DELETE /compute/v2.1/servers/af97f825-9004-4c4d-a0da-479b2465b189 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 15:58:03.866970 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7d625166-650b-466e-b1f8-d4f58836c951 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:03.867845 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7d625166-650b-466e-b1f8-d4f58836c951 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] [instance: af97f825-9004-4c4d-a0da-479b2465b189] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:03.874124 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d625166-650b-466e-b1f8-d4f58836c951 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:03.874694 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d625166-650b-466e-b1f8-d4f58836c951 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:03.875353 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d625166-650b-466e-b1f8-d4f58836c951 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:03.876283 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d625166-650b-466e-b1f8-d4f58836c951 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:03.876809 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d625166-650b-466e-b1f8-d4f58836c951 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:03.877307 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d625166-650b-466e-b1f8-d4f58836c951 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:04.060335 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-7d625166-650b-466e-b1f8-d4f58836c951 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a393cb6b2343d697ec2e87d750c70a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf52e3718140d1b2e4883f8d5464f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:04.070054 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7d625166-650b-466e-b1f8-d4f58836c951 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] 10.222.0.17 "GET /compute/v2.1/servers/af97f825-9004-4c4d-a0da-479b2465b189" status: 200 len: 1504 microversion: 2.1 time: 0.206831 Sep 07 15:58:04.070834 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 138/287] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:03 2022] GET /compute/v2.1/servers/af97f825-9004-4c4d-a0da-479b2465b189 => generated 1504 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:04.748405 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c6f376f8-0a3e-4aff-b511-e8dbb10927f8 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:04.749094 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c6f376f8-0a3e-4aff-b511-e8dbb10927f8 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:04.755300 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6f376f8-0a3e-4aff-b511-e8dbb10927f8 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:04.755822 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6f376f8-0a3e-4aff-b511-e8dbb10927f8 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:04.756260 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6f376f8-0a3e-4aff-b511-e8dbb10927f8 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:04.756947 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6f376f8-0a3e-4aff-b511-e8dbb10927f8 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:04.757611 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6f376f8-0a3e-4aff-b511-e8dbb10927f8 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:04.758040 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6f376f8-0a3e-4aff-b511-e8dbb10927f8 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:04.792459 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6f376f8-0a3e-4aff-b511-e8dbb10927f8 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:04.793237 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6f376f8-0a3e-4aff-b511-e8dbb10927f8 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:04.794162 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6f376f8-0a3e-4aff-b511-e8dbb10927f8 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:04.794937 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-c6f376f8-0a3e-4aff-b511-e8dbb10927f8 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lazy-loading 'fault' on Instance uuid 881d1d65-f44f-40d2-9e0e-01f29e5bd88a {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 15:58:04.867196 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c6f376f8-0a3e-4aff-b511-e8dbb10927f8 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de43a221bd8148b39eabc978b97f0e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d24ce688df84f049775fa082eefcdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:04.892758 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c6f376f8-0a3e-4aff-b511-e8dbb10927f8 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 200 len: 1351 microversion: 2.1 time: 0.148242 Sep 07 15:58:04.898724 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 150/288] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:04 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 1351 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:05.093419 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b7ec2ed0-964a-46fe-b67a-3909e652cf6a tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:05.095288 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b7ec2ed0-964a-46fe-b67a-3909e652cf6a tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] [instance: af97f825-9004-4c4d-a0da-479b2465b189] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:05.103575 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7ec2ed0-964a-46fe-b67a-3909e652cf6a tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:05.104824 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7ec2ed0-964a-46fe-b67a-3909e652cf6a tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:05.105383 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7ec2ed0-964a-46fe-b67a-3909e652cf6a tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:05.106184 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7ec2ed0-964a-46fe-b67a-3909e652cf6a tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:05.106767 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7ec2ed0-964a-46fe-b67a-3909e652cf6a tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:05.107259 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7ec2ed0-964a-46fe-b67a-3909e652cf6a tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:05.516183 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-b7ec2ed0-964a-46fe-b67a-3909e652cf6a tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a393cb6b2343d697ec2e87d750c70a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf52e3718140d1b2e4883f8d5464f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:05.527900 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b7ec2ed0-964a-46fe-b67a-3909e652cf6a tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] 10.222.0.17 "GET /compute/v2.1/servers/af97f825-9004-4c4d-a0da-479b2465b189" status: 200 len: 1504 microversion: 2.1 time: 0.438364 Sep 07 15:58:05.545562 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 139/289] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:05 2022] GET /compute/v2.1/servers/af97f825-9004-4c4d-a0da-479b2465b189 => generated 1504 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:05.921369 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f2e5e62c-978b-46f0-bd4f-1c3d37a93ab9 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:05.922059 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f2e5e62c-978b-46f0-bd4f-1c3d37a93ab9 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:05.929518 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2e5e62c-978b-46f0-bd4f-1c3d37a93ab9 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:05.929518 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2e5e62c-978b-46f0-bd4f-1c3d37a93ab9 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:05.929518 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2e5e62c-978b-46f0-bd4f-1c3d37a93ab9 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:05.929856 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2e5e62c-978b-46f0-bd4f-1c3d37a93ab9 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:05.930401 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2e5e62c-978b-46f0-bd4f-1c3d37a93ab9 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:05.930884 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f2e5e62c-978b-46f0-bd4f-1c3d37a93ab9 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:05.946241 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-f2e5e62c-978b-46f0-bd4f-1c3d37a93ab9 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] HTTP exception thrown: Instance 881d1d65-f44f-40d2-9e0e-01f29e5bd88a could not be found. Sep 07 15:58:05.951158 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f2e5e62c-978b-46f0-bd4f-1c3d37a93ab9 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Request method failure captured: Sep 07 15:58:05.951158 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a HTTP/1.1 Sep 07 15:58:05.951158 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept: application/json Sep 07 15:58:05.951158 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Sep 07 15:58:05.951158 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Connection: close Sep 07 15:58:05.951158 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Length: 0 Sep 07 15:58:05.951158 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Type: application/json Sep 07 15:58:05.951158 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Host: 10.222.0.17 Sep 07 15:58:05.951158 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Sep 07 15:58:05.951158 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Sep 07 15:58:05.951158 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjGL8Tbc68nu2rDo3jKphs2UrXPBZQ1sK4OQ7pNXZx-9ASTNO45uNX6vofhTWXtpkJe0blLE4EPIlinpIeo30-zMhCJJRvhqr4PFsSHkZvZaRJEU7dMhWOWztELHIHUQv-T0WfqkUKQMTpGU2LMefb_vdI75T7R_ItI8c4gb8Li34zceI Sep 07 15:58:05.951158 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Sep 07 15:58:05.951158 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Sep 07 15:58:05.951158 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Sep 07 15:58:05.951158 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Sep 07 15:58:05.951158 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Sep 07 15:58:05.951158 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Sep 07 15:58:05.951158 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Id: 5d24ce688df84f049775fa082eefcdce Sep 07 15:58:05.951158 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-DeleteServersTestJSON-458700024 Sep 07 15:58:05.951158 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Role: reader,member Sep 07 15:58:05.951158 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Roles: reader,member Sep 07 15:58:05.953173 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5d24ce688df84f049775fa082eefcdce", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5d24ce688df84f049775fa082eefcdce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5d24ce688df84f049775fa082eefcdce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5d24ce688df84f049775fa082eefcdce"}]}] Sep 07 15:58:05.953173 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-DeleteServersTestJSON-458700024 Sep 07 15:58:05.953173 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Id: 5d24ce688df84f049775fa082eefcdce Sep 07 15:58:05.953173 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-DeleteServersTestJSON-458700024 Sep 07 15:58:05.953173 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User: tempest-DeleteServersTestJSON-458700024-project Sep 07 15:58:05.953173 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Sep 07 15:58:05.953173 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Sep 07 15:58:05.953173 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Id: de43a221bd8148b39eabc978b97f0e2a Sep 07 15:58:05.953173 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-DeleteServersTestJSON-458700024-project Sep 07 15:58:05.953173 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: method: > Sep 07 15:58:05.953173 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: exception: Instance 881d1d65-f44f-40d2-9e0e-01f29e5bd88a could not be found. Sep 07 15:58:05.953173 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: action_args: {'id': '881d1d65-f44f-40d2-9e0e-01f29e5bd88a'} Sep 07 15:58:05.953910 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 15:58:05.953910 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:58:05.953910 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 15:58:05.953910 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 15:58:05.953910 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 15:58:05.953910 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 15:58:05.953910 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 15:58:05.953910 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 15:58:05.953910 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 15:58:05.953910 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 15:58:05.953910 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 881d1d65-f44f-40d2-9e0e-01f29e5bd88a could not be found. Sep 07 15:58:05.953910 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:58:05.953910 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 15:58:05.953910 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:58:05.953910 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:58:05.953910 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 15:58:05.953910 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 15:58:05.953910 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 15:58:05.953910 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 15:58:05.953910 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 15:58:05.955082 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 15:58:05.955082 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 15:58:05.955082 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 15:58:05.955082 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 15:58:05.955082 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 15:58:05.955082 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 15:58:05.955082 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 15:58:05.955082 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 881d1d65-f44f-40d2-9e0e-01f29e5bd88a could not be found. Sep 07 15:58:05.955082 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:58:05.955082 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 15:58:05.955082 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:58:05.955082 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:58:05.955082 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 15:58:05.955082 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 15:58:05.955082 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 15:58:05.955082 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 15:58:05.955082 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 881d1d65-f44f-40d2-9e0e-01f29e5bd88a could not be found. Sep 07 15:58:05.955082 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:58:05.958042 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f2e5e62c-978b-46f0-bd4f-1c3d37a93ab9 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Returning 404 to user: Instance 881d1d65-f44f-40d2-9e0e-01f29e5bd88a could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 15:58:05.959182 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f2e5e62c-978b-46f0-bd4f-1c3d37a93ab9 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 404 len: 111 microversion: 2.1 time: 0.041939 Sep 07 15:58:05.960096 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 151/290] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:05 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 15:58:06.091522 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dd655329-4139-4a50-a31e-1ac7ab9533a3 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:06.094483 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-dd655329-4139-4a50-a31e-1ac7ab9533a3 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:06.103297 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd655329-4139-4a50-a31e-1ac7ab9533a3 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:06.104201 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd655329-4139-4a50-a31e-1ac7ab9533a3 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:06.104956 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd655329-4139-4a50-a31e-1ac7ab9533a3 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:06.105999 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd655329-4139-4a50-a31e-1ac7ab9533a3 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:06.106617 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd655329-4139-4a50-a31e-1ac7ab9533a3 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:06.107198 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd655329-4139-4a50-a31e-1ac7ab9533a3 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:06.123533 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-dd655329-4139-4a50-a31e-1ac7ab9533a3 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] HTTP exception thrown: Instance 881d1d65-f44f-40d2-9e0e-01f29e5bd88a could not be found. Sep 07 15:58:06.130235 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dd655329-4139-4a50-a31e-1ac7ab9533a3 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Request method failure captured: Sep 07 15:58:06.130235 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a/os-volume_attachments HTTP/1.1 Sep 07 15:58:06.130235 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Accept: application/json Sep 07 15:58:06.130235 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Accept-Encoding: identity Sep 07 15:58:06.130235 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Connection: close Sep 07 15:58:06.130235 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Content-Length: 0 Sep 07 15:58:06.130235 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Content-Type: application/json Sep 07 15:58:06.130235 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Host: 10.222.0.17 Sep 07 15:58:06.130235 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Openstack-System-Scope: None Sep 07 15:58:06.130235 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Sep 07 15:58:06.130235 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjGL8Tbc68nu2rDo3jKphs2UrXPBZQ1sK4OQ7pNXZx-9ASTNO45uNX6vofhTWXtpkJe0blLE4EPIlinpIeo30-zMhCJJRvhqr4PFsSHkZvZaRJEU7dMhWOWztELHIHUQv-T0WfqkUKQMTpGU2LMefb_vdI75T7R_ItI8c4gb8Li34zceI Sep 07 15:58:06.130235 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Domain-Id: None Sep 07 15:58:06.130235 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Domain-Name: None Sep 07 15:58:06.130235 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Identity-Status: Confirmed Sep 07 15:58:06.130235 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Is-Admin-Project: True Sep 07 15:58:06.130235 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Domain-Id: default Sep 07 15:58:06.130235 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Domain-Name: Default Sep 07 15:58:06.130235 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Id: 5d24ce688df84f049775fa082eefcdce Sep 07 15:58:06.130235 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Name: tempest-DeleteServersTestJSON-458700024 Sep 07 15:58:06.130235 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Role: reader,member Sep 07 15:58:06.130235 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Roles: reader,member Sep 07 15:58:06.131895 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5d24ce688df84f049775fa082eefcdce", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5d24ce688df84f049775fa082eefcdce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5d24ce688df84f049775fa082eefcdce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5d24ce688df84f049775fa082eefcdce"}]}] Sep 07 15:58:06.131895 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant: tempest-DeleteServersTestJSON-458700024 Sep 07 15:58:06.131895 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant-Id: 5d24ce688df84f049775fa082eefcdce Sep 07 15:58:06.131895 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant-Name: tempest-DeleteServersTestJSON-458700024 Sep 07 15:58:06.131895 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User: tempest-DeleteServersTestJSON-458700024-project Sep 07 15:58:06.131895 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Domain-Id: default Sep 07 15:58:06.131895 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Domain-Name: Default Sep 07 15:58:06.131895 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Id: de43a221bd8148b39eabc978b97f0e2a Sep 07 15:58:06.131895 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Name: tempest-DeleteServersTestJSON-458700024-project Sep 07 15:58:06.131895 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: method: > Sep 07 15:58:06.131895 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: exception: Instance 881d1d65-f44f-40d2-9e0e-01f29e5bd88a could not be found. Sep 07 15:58:06.131895 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: action_args: {'server_id': '881d1d65-f44f-40d2-9e0e-01f29e5bd88a'} Sep 07 15:58:06.132682 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 15:58:06.132682 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:58:06.132682 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 15:58:06.132682 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 15:58:06.132682 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 15:58:06.132682 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 15:58:06.132682 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 15:58:06.132682 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 15:58:06.132682 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 15:58:06.132682 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 15:58:06.132682 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 881d1d65-f44f-40d2-9e0e-01f29e5bd88a could not be found. Sep 07 15:58:06.132682 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 15:58:06.132682 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 15:58:06.132682 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 15:58:06.132682 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:58:06.132682 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 15:58:06.132682 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 15:58:06.132682 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 15:58:06.132682 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 15:58:06.132682 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 15:58:06.133815 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 15:58:06.133815 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 15:58:06.133815 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 15:58:06.133815 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 15:58:06.133815 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 15:58:06.133815 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 07 15:58:06.133815 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 07 15:58:06.133815 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 15:58:06.133815 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 15:58:06.133815 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 881d1d65-f44f-40d2-9e0e-01f29e5bd88a could not be found. Sep 07 15:58:06.133815 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 15:58:06.133815 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 15:58:06.133815 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 15:58:06.133815 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:58:06.133815 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 15:58:06.133815 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 15:58:06.133815 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 15:58:06.133815 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 15:58:06.133815 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 881d1d65-f44f-40d2-9e0e-01f29e5bd88a could not be found. Sep 07 15:58:06.133815 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 15:58:06.137007 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dd655329-4139-4a50-a31e-1ac7ab9533a3 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Returning 404 to user: Instance 881d1d65-f44f-40d2-9e0e-01f29e5bd88a could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 15:58:06.137855 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-dd655329-4139-4a50-a31e-1ac7ab9533a3 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.050918 Sep 07 15:58:06.138777 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 140/291] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Sep 7 15:58:06 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a/os-volume_attachments => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 15:58:06.298652 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2a8f1eed-663b-452a-aca3-ca08824d136f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:58:06.302060 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2a8f1eed-663b-452a-aca3-ca08824d136f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: f39427e6-62a5-4a4e-96e8-644f03653722] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:06.311030 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a8f1eed-663b-452a-aca3-ca08824d136f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:06.311832 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a8f1eed-663b-452a-aca3-ca08824d136f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:06.312567 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a8f1eed-663b-452a-aca3-ca08824d136f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:06.313493 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a8f1eed-663b-452a-aca3-ca08824d136f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:06.314528 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a8f1eed-663b-452a-aca3-ca08824d136f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:06.315354 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a8f1eed-663b-452a-aca3-ca08824d136f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:06.347102 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-2a8f1eed-663b-452a-aca3-ca08824d136f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lazy-loading 'flavor' on Instance uuid f39427e6-62a5-4a4e-96e8-644f03653722 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 15:58:06.469436 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2a8f1eed-663b-452a-aca3-ca08824d136f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "POST /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722/action" status: 200 len: 32 microversion: 2.1 time: 0.175360 Sep 07 15:58:06.474774 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 152/292] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Sep 7 15:58:06 2022] POST /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722/action => generated 32 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 15:58:06.481479 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-52703b7b-ac55-41ff-9c6f-0c3cd4c0f0e5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:06.482390 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-52703b7b-ac55-41ff-9c6f-0c3cd4c0f0e5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: f39427e6-62a5-4a4e-96e8-644f03653722] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:06.492773 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-52703b7b-ac55-41ff-9c6f-0c3cd4c0f0e5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:06.493099 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-52703b7b-ac55-41ff-9c6f-0c3cd4c0f0e5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:06.493781 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-52703b7b-ac55-41ff-9c6f-0c3cd4c0f0e5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:06.494334 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-52703b7b-ac55-41ff-9c6f-0c3cd4c0f0e5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:06.495053 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-52703b7b-ac55-41ff-9c6f-0c3cd4c0f0e5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:06.495686 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-52703b7b-ac55-41ff-9c6f-0c3cd4c0f0e5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:06.557668 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e0a3656c-aa58-43ad-b8f3-eddfd4924b18 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:06.558739 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e0a3656c-aa58-43ad-b8f3-eddfd4924b18 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] [instance: af97f825-9004-4c4d-a0da-479b2465b189] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:06.569482 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e0a3656c-aa58-43ad-b8f3-eddfd4924b18 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:06.575929 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e0a3656c-aa58-43ad-b8f3-eddfd4924b18 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:06.576232 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e0a3656c-aa58-43ad-b8f3-eddfd4924b18 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:06.580085 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e0a3656c-aa58-43ad-b8f3-eddfd4924b18 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:06.581651 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e0a3656c-aa58-43ad-b8f3-eddfd4924b18 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:06.582429 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e0a3656c-aa58-43ad-b8f3-eddfd4924b18 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:06.734362 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e0a3656c-aa58-43ad-b8f3-eddfd4924b18 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a393cb6b2343d697ec2e87d750c70a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf52e3718140d1b2e4883f8d5464f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:06.744223 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e0a3656c-aa58-43ad-b8f3-eddfd4924b18 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] 10.222.0.17 "GET /compute/v2.1/servers/af97f825-9004-4c4d-a0da-479b2465b189" status: 200 len: 1462 microversion: 2.1 time: 0.193116 Sep 07 15:58:06.760120 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 153/293] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:06 2022] GET /compute/v2.1/servers/af97f825-9004-4c4d-a0da-479b2465b189 => generated 1462 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:58:06.773000 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-7d20f644-0dcf-4718-a408-e07218d5d99a req-387a8be2-598d-4f2e-93ee-24f55f2075f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af97f825-9004-4c4d-a0da-479b2465b189", "name": "network-vif-deleted", "tag": "30b26de7-eda7-43df-a617-41c604f06a9a"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:58:06.794776 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-7d20f644-0dcf-4718-a408-e07218d5d99a req-387a8be2-598d-4f2e-93ee-24f55f2075f5 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:06.810185 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-7d20f644-0dcf-4718-a408-e07218d5d99a req-387a8be2-598d-4f2e-93ee-24f55f2075f5 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:06.810950 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-7d20f644-0dcf-4718-a408-e07218d5d99a req-387a8be2-598d-4f2e-93ee-24f55f2075f5 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:06.893055 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-52703b7b-ac55-41ff-9c6f-0c3cd4c0f0e5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:06.904097 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-52703b7b-ac55-41ff-9c6f-0c3cd4c0f0e5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722" status: 200 len: 1521 microversion: 2.1 time: 0.426051 Sep 07 15:58:06.905316 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 141/294] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:06 2022] GET /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722 => generated 1521 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:07.029615 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-7d20f644-0dcf-4718-a408-e07218d5d99a req-387a8be2-598d-4f2e-93ee-24f55f2075f5 service nova] Creating event network-vif-deleted:30b26de7-eda7-43df-a617-41c604f06a9a for instance af97f825-9004-4c4d-a0da-479b2465b189 on hv-cinder-85331 Sep 07 15:58:07.039898 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-7d20f644-0dcf-4718-a408-e07218d5d99a req-387a8be2-598d-4f2e-93ee-24f55f2075f5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.270602 Sep 07 15:58:07.040828 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 154/295] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 15:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:58:07.442195 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-aeea99d5-c33f-46ee-9ba9-c461be5953f4 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:07.442692 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-aeea99d5-c33f-46ee-9ba9-c461be5953f4 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:07.449549 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aeea99d5-c33f-46ee-9ba9-c461be5953f4 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:07.450085 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aeea99d5-c33f-46ee-9ba9-c461be5953f4 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:07.450529 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aeea99d5-c33f-46ee-9ba9-c461be5953f4 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:07.453078 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aeea99d5-c33f-46ee-9ba9-c461be5953f4 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:07.453546 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aeea99d5-c33f-46ee-9ba9-c461be5953f4 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:07.454332 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aeea99d5-c33f-46ee-9ba9-c461be5953f4 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:07.470006 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-aeea99d5-c33f-46ee-9ba9-c461be5953f4 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] HTTP exception thrown: Instance 881d1d65-f44f-40d2-9e0e-01f29e5bd88a could not be found. Sep 07 15:58:07.472835 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-aeea99d5-c33f-46ee-9ba9-c461be5953f4 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Request method failure captured: Sep 07 15:58:07.472835 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: request: DELETE /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a HTTP/1.1 Sep 07 15:58:07.472835 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Accept: application/json Sep 07 15:58:07.472835 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Accept-Encoding: identity Sep 07 15:58:07.472835 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Connection: close Sep 07 15:58:07.472835 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Content-Length: 0 Sep 07 15:58:07.472835 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Content-Type: application/json Sep 07 15:58:07.472835 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Host: 10.222.0.17 Sep 07 15:58:07.472835 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Openstack-System-Scope: None Sep 07 15:58:07.472835 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Sep 07 15:58:07.472835 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjGL8Tbc68nu2rDo3jKphs2UrXPBZQ1sK4OQ7pNXZx-9ASTNO45uNX6vofhTWXtpkJe0blLE4EPIlinpIeo30-zMhCJJRvhqr4PFsSHkZvZaRJEU7dMhWOWztELHIHUQv-T0WfqkUKQMTpGU2LMefb_vdI75T7R_ItI8c4gb8Li34zceI Sep 07 15:58:07.472835 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Domain-Id: None Sep 07 15:58:07.472835 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Domain-Name: None Sep 07 15:58:07.472835 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Identity-Status: Confirmed Sep 07 15:58:07.472835 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Is-Admin-Project: True Sep 07 15:58:07.472835 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Domain-Id: default Sep 07 15:58:07.472835 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Domain-Name: Default Sep 07 15:58:07.472835 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Id: 5d24ce688df84f049775fa082eefcdce Sep 07 15:58:07.472835 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Name: tempest-DeleteServersTestJSON-458700024 Sep 07 15:58:07.472835 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Role: reader,member Sep 07 15:58:07.472835 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Roles: reader,member Sep 07 15:58:07.474240 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5d24ce688df84f049775fa082eefcdce", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5d24ce688df84f049775fa082eefcdce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5d24ce688df84f049775fa082eefcdce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5d24ce688df84f049775fa082eefcdce"}]}] Sep 07 15:58:07.474240 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant: tempest-DeleteServersTestJSON-458700024 Sep 07 15:58:07.474240 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant-Id: 5d24ce688df84f049775fa082eefcdce Sep 07 15:58:07.474240 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant-Name: tempest-DeleteServersTestJSON-458700024 Sep 07 15:58:07.474240 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User: tempest-DeleteServersTestJSON-458700024-project Sep 07 15:58:07.474240 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Domain-Id: default Sep 07 15:58:07.474240 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Domain-Name: Default Sep 07 15:58:07.474240 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Id: de43a221bd8148b39eabc978b97f0e2a Sep 07 15:58:07.474240 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Name: tempest-DeleteServersTestJSON-458700024-project Sep 07 15:58:07.474240 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: method: > Sep 07 15:58:07.474240 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: exception: Instance 881d1d65-f44f-40d2-9e0e-01f29e5bd88a could not be found. Sep 07 15:58:07.474240 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: action_args: {'id': '881d1d65-f44f-40d2-9e0e-01f29e5bd88a'} Sep 07 15:58:07.478768 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 15:58:07.478768 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:58:07.478768 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 15:58:07.478768 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 15:58:07.478768 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 15:58:07.478768 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 15:58:07.478768 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 15:58:07.478768 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 15:58:07.478768 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 15:58:07.478768 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 15:58:07.478768 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 881d1d65-f44f-40d2-9e0e-01f29e5bd88a could not be found. Sep 07 15:58:07.478768 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 15:58:07.478768 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 15:58:07.478768 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 15:58:07.478768 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:58:07.478768 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 15:58:07.478768 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 15:58:07.478768 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 15:58:07.478768 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 15:58:07.478768 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 15:58:07.480302 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 15:58:07.480302 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 15:58:07.480302 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 15:58:07.480302 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 15:58:07.480302 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 15:58:07.480302 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 15:58:07.480302 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 15:58:07.480302 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 15:58:07.480302 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 15:58:07.480302 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 881d1d65-f44f-40d2-9e0e-01f29e5bd88a could not be found. Sep 07 15:58:07.480302 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 15:58:07.480302 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 15:58:07.480302 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 15:58:07.480302 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:58:07.480302 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 15:58:07.480302 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 15:58:07.480302 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 15:58:07.480302 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 15:58:07.480302 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 881d1d65-f44f-40d2-9e0e-01f29e5bd88a could not be found. Sep 07 15:58:07.480302 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 15:58:07.481455 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-aeea99d5-c33f-46ee-9ba9-c461be5953f4 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Returning 404 to user: Instance 881d1d65-f44f-40d2-9e0e-01f29e5bd88a could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 15:58:07.481455 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-aeea99d5-c33f-46ee-9ba9-c461be5953f4 tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "DELETE /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 404 len: 111 microversion: 2.1 time: 0.038980 Sep 07 15:58:07.481455 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 142/296] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Sep 7 15:58:07 2022] DELETE /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 15:58:07.484642 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-512b18e3-578d-4c51-a301-a1669963847c tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:07.485327 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-512b18e3-578d-4c51-a301-a1669963847c tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] [instance: 881d1d65-f44f-40d2-9e0e-01f29e5bd88a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:07.491755 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-512b18e3-578d-4c51-a301-a1669963847c tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:07.492267 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-512b18e3-578d-4c51-a301-a1669963847c tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:07.492643 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-512b18e3-578d-4c51-a301-a1669963847c tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:07.493400 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-512b18e3-578d-4c51-a301-a1669963847c tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:07.493833 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-512b18e3-578d-4c51-a301-a1669963847c tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:07.494196 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-512b18e3-578d-4c51-a301-a1669963847c tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:07.507504 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-512b18e3-578d-4c51-a301-a1669963847c tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] HTTP exception thrown: Instance 881d1d65-f44f-40d2-9e0e-01f29e5bd88a could not be found. Sep 07 15:58:07.509185 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-512b18e3-578d-4c51-a301-a1669963847c tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Request method failure captured: Sep 07 15:58:07.509185 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a HTTP/1.1 Sep 07 15:58:07.509185 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept: application/json Sep 07 15:58:07.509185 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Sep 07 15:58:07.509185 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Connection: close Sep 07 15:58:07.509185 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Length: 0 Sep 07 15:58:07.509185 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Type: application/json Sep 07 15:58:07.509185 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Host: 10.222.0.17 Sep 07 15:58:07.509185 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Sep 07 15:58:07.509185 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Sep 07 15:58:07.509185 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjGL8Tbc68nu2rDo3jKphs2UrXPBZQ1sK4OQ7pNXZx-9ASTNO45uNX6vofhTWXtpkJe0blLE4EPIlinpIeo30-zMhCJJRvhqr4PFsSHkZvZaRJEU7dMhWOWztELHIHUQv-T0WfqkUKQMTpGU2LMefb_vdI75T7R_ItI8c4gb8Li34zceI Sep 07 15:58:07.509185 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Sep 07 15:58:07.509185 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Sep 07 15:58:07.509185 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Sep 07 15:58:07.509185 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Sep 07 15:58:07.509185 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Sep 07 15:58:07.509185 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Sep 07 15:58:07.509185 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Id: 5d24ce688df84f049775fa082eefcdce Sep 07 15:58:07.509185 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-DeleteServersTestJSON-458700024 Sep 07 15:58:07.509185 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Role: reader,member Sep 07 15:58:07.509185 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Roles: reader,member Sep 07 15:58:07.510623 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5d24ce688df84f049775fa082eefcdce", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5d24ce688df84f049775fa082eefcdce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5d24ce688df84f049775fa082eefcdce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5d24ce688df84f049775fa082eefcdce"}]}] Sep 07 15:58:07.510623 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-DeleteServersTestJSON-458700024 Sep 07 15:58:07.510623 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Id: 5d24ce688df84f049775fa082eefcdce Sep 07 15:58:07.510623 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-DeleteServersTestJSON-458700024 Sep 07 15:58:07.510623 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User: tempest-DeleteServersTestJSON-458700024-project Sep 07 15:58:07.510623 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Sep 07 15:58:07.510623 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Sep 07 15:58:07.510623 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Id: de43a221bd8148b39eabc978b97f0e2a Sep 07 15:58:07.510623 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-DeleteServersTestJSON-458700024-project Sep 07 15:58:07.510623 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: method: > Sep 07 15:58:07.510623 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: exception: Instance 881d1d65-f44f-40d2-9e0e-01f29e5bd88a could not be found. Sep 07 15:58:07.510623 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: action_args: {'id': '881d1d65-f44f-40d2-9e0e-01f29e5bd88a'} Sep 07 15:58:07.511999 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 15:58:07.511999 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:58:07.511999 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 15:58:07.511999 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 15:58:07.511999 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 15:58:07.511999 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 15:58:07.511999 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 15:58:07.511999 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 15:58:07.511999 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 15:58:07.511999 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 15:58:07.511999 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 881d1d65-f44f-40d2-9e0e-01f29e5bd88a could not be found. Sep 07 15:58:07.511999 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:58:07.511999 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 15:58:07.511999 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:58:07.511999 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:58:07.511999 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 15:58:07.511999 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 15:58:07.511999 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 15:58:07.511999 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 15:58:07.511999 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 15:58:07.513581 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 15:58:07.513581 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 15:58:07.513581 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 15:58:07.513581 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 15:58:07.513581 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 15:58:07.513581 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 15:58:07.513581 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 15:58:07.513581 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 881d1d65-f44f-40d2-9e0e-01f29e5bd88a could not be found. Sep 07 15:58:07.513581 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:58:07.513581 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 15:58:07.513581 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:58:07.513581 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:58:07.513581 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 15:58:07.513581 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 15:58:07.513581 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 15:58:07.513581 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 15:58:07.513581 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 881d1d65-f44f-40d2-9e0e-01f29e5bd88a could not be found. Sep 07 15:58:07.513581 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:58:07.515723 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-512b18e3-578d-4c51-a301-a1669963847c tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] Returning 404 to user: Instance 881d1d65-f44f-40d2-9e0e-01f29e5bd88a could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 15:58:07.515723 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-512b18e3-578d-4c51-a301-a1669963847c tempest-DeleteServersTestJSON-458700024 tempest-DeleteServersTestJSON-458700024-project] 10.222.0.17 "GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a" status: 404 len: 111 microversion: 2.1 time: 0.030727 Sep 07 15:58:07.515723 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 155/297] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:07 2022] GET /compute/v2.1/servers/881d1d65-f44f-40d2-9e0e-01f29e5bd88a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 15:58:07.769217 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a6c486d5-87b8-4201-a6f4-623727c0982c tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:07.769837 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a6c486d5-87b8-4201-a6f4-623727c0982c tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] [instance: af97f825-9004-4c4d-a0da-479b2465b189] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:07.777903 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a6c486d5-87b8-4201-a6f4-623727c0982c tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:07.778395 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a6c486d5-87b8-4201-a6f4-623727c0982c tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:07.779148 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a6c486d5-87b8-4201-a6f4-623727c0982c tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:07.782655 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a6c486d5-87b8-4201-a6f4-623727c0982c tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:07.784616 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a6c486d5-87b8-4201-a6f4-623727c0982c tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:07.785109 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a6c486d5-87b8-4201-a6f4-623727c0982c tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:07.817305 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-a6c486d5-87b8-4201-a6f4-623727c0982c tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] HTTP exception thrown: Instance af97f825-9004-4c4d-a0da-479b2465b189 could not be found. Sep 07 15:58:07.819067 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a6c486d5-87b8-4201-a6f4-623727c0982c tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Request method failure captured: Sep 07 15:58:07.819067 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/af97f825-9004-4c4d-a0da-479b2465b189 HTTP/1.1 Sep 07 15:58:07.819067 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Accept: application/json Sep 07 15:58:07.819067 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Accept-Encoding: identity Sep 07 15:58:07.819067 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Connection: close Sep 07 15:58:07.819067 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Content-Length: 0 Sep 07 15:58:07.819067 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Content-Type: application/json Sep 07 15:58:07.819067 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Host: 10.222.0.17 Sep 07 15:58:07.819067 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Openstack-System-Scope: None Sep 07 15:58:07.819067 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Sep 07 15:58:07.819067 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjGL9mXiE7hbYOlKchVchMyPeJFidODTaSOJj-YwR-A7JC596J3xCzx5ZqusPkGbl59wR2-wMAq9QQBlyucV1Bk29rqSyJ417r9nKpkgFpOrZVagK_WC3CbGTsUEEplybBGzUeDJdJg_dZRcSIdXEqtsxpqaw-61EbD9X-ViiQBXUFYQM Sep 07 15:58:07.819067 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Domain-Id: None Sep 07 15:58:07.819067 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Domain-Name: None Sep 07 15:58:07.819067 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Identity-Status: Confirmed Sep 07 15:58:07.819067 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Is-Admin-Project: True Sep 07 15:58:07.819067 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Domain-Id: default Sep 07 15:58:07.819067 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Domain-Name: Default Sep 07 15:58:07.819067 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Id: 4ebf52e3718140d1b2e4883f8d5464f4 Sep 07 15:58:07.819067 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Name: tempest-VolumesActionsTest-318390915 Sep 07 15:58:07.819067 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Role: reader,member Sep 07 15:58:07.819067 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Roles: reader,member Sep 07 15:58:07.820340 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4ebf52e3718140d1b2e4883f8d5464f4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4ebf52e3718140d1b2e4883f8d5464f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4ebf52e3718140d1b2e4883f8d5464f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4ebf52e3718140d1b2e4883f8d5464f4"}]}] Sep 07 15:58:07.820340 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant: tempest-VolumesActionsTest-318390915 Sep 07 15:58:07.820340 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant-Id: 4ebf52e3718140d1b2e4883f8d5464f4 Sep 07 15:58:07.820340 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant-Name: tempest-VolumesActionsTest-318390915 Sep 07 15:58:07.820340 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User: tempest-VolumesActionsTest-318390915-project Sep 07 15:58:07.820340 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Domain-Id: default Sep 07 15:58:07.820340 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Domain-Name: Default Sep 07 15:58:07.820340 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Id: 72a393cb6b2343d697ec2e87d750c70a Sep 07 15:58:07.820340 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Name: tempest-VolumesActionsTest-318390915-project Sep 07 15:58:07.820340 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: method: > Sep 07 15:58:07.820340 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: exception: Instance af97f825-9004-4c4d-a0da-479b2465b189 could not be found. Sep 07 15:58:07.820340 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: action_args: {'id': 'af97f825-9004-4c4d-a0da-479b2465b189'} Sep 07 15:58:07.821060 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 15:58:07.821060 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:58:07.821060 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 15:58:07.821060 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 15:58:07.821060 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 15:58:07.821060 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 15:58:07.821060 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 15:58:07.821060 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 15:58:07.821060 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 15:58:07.821060 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 15:58:07.821060 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af97f825-9004-4c4d-a0da-479b2465b189 could not be found. Sep 07 15:58:07.821060 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 15:58:07.821060 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 15:58:07.821060 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 15:58:07.821060 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:58:07.821060 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 15:58:07.821060 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 15:58:07.821060 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 15:58:07.821060 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 15:58:07.821060 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 15:58:07.822160 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 15:58:07.822160 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 15:58:07.822160 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 15:58:07.822160 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 15:58:07.822160 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 15:58:07.822160 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 15:58:07.822160 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 15:58:07.822160 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af97f825-9004-4c4d-a0da-479b2465b189 could not be found. Sep 07 15:58:07.822160 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 15:58:07.822160 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 15:58:07.822160 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 15:58:07.822160 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:58:07.822160 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 15:58:07.822160 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 15:58:07.822160 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 15:58:07.822160 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 15:58:07.822160 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af97f825-9004-4c4d-a0da-479b2465b189 could not be found. Sep 07 15:58:07.822160 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 15:58:07.825229 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a6c486d5-87b8-4201-a6f4-623727c0982c tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Returning 404 to user: Instance af97f825-9004-4c4d-a0da-479b2465b189 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 15:58:07.826448 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a6c486d5-87b8-4201-a6f4-623727c0982c tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] 10.222.0.17 "GET /compute/v2.1/servers/af97f825-9004-4c4d-a0da-479b2465b189" status: 404 len: 111 microversion: 2.1 time: 0.061714 Sep 07 15:58:07.828446 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 143/298] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:07 2022] GET /compute/v2.1/servers/af97f825-9004-4c4d-a0da-479b2465b189 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 15:58:07.932752 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-629d1ea8-1fa0-468d-acea-b1529a7ff131 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:07.933738 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-629d1ea8-1fa0-468d-acea-b1529a7ff131 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: f39427e6-62a5-4a4e-96e8-644f03653722] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:07.945965 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-629d1ea8-1fa0-468d-acea-b1529a7ff131 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:07.949963 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-629d1ea8-1fa0-468d-acea-b1529a7ff131 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:07.950932 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-629d1ea8-1fa0-468d-acea-b1529a7ff131 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:07.953149 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-629d1ea8-1fa0-468d-acea-b1529a7ff131 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:07.955184 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-629d1ea8-1fa0-468d-acea-b1529a7ff131 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:07.956685 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-629d1ea8-1fa0-468d-acea-b1529a7ff131 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:07.990175 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-21df0d3b-26a5-44ad-b5c4-f09a86302b97 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1033414645", "imageRef": "cfe19284-9779-46f4-b458-81d5475ec82f", "flavorRef": "452", "networks": [{"uuid": "7e254e5b-3167-44b3-9e81-f229655afc11"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:58:08.083374 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-21df0d3b-26a5-44ad-b5c4-f09a86302b97 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] validate_networks() for [('7e254e5b-3167-44b3-9e81-f229655afc11', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 15:58:08.260110 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-629d1ea8-1fa0-468d-acea-b1529a7ff131 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:08.271162 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-629d1ea8-1fa0-468d-acea-b1529a7ff131 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722" status: 200 len: 1521 microversion: 2.1 time: 0.342741 Sep 07 15:58:08.272231 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 156/299] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:07 2022] GET /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722 => generated 1521 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:08.576802 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-21df0d3b-26a5-44ad-b5c4-f09a86302b97 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 15:58:08.577330 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-21df0d3b-26a5-44ad-b5c4-f09a86302b97 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 15:58:08.578030 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-21df0d3b-26a5-44ad-b5c4-f09a86302b97 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 15:58:08.578542 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-21df0d3b-26a5-44ad-b5c4-f09a86302b97 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 15:58:08.579059 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-21df0d3b-26a5-44ad-b5c4-f09a86302b97 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 15:58:08.589507 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-21df0d3b-26a5-44ad-b5c4-f09a86302b97 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:08.590152 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-21df0d3b-26a5-44ad-b5c4-f09a86302b97 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:08.590988 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-21df0d3b-26a5-44ad-b5c4-f09a86302b97 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:08.591966 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-21df0d3b-26a5-44ad-b5c4-f09a86302b97 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:08.593089 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-21df0d3b-26a5-44ad-b5c4-f09a86302b97 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:08.593661 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-21df0d3b-26a5-44ad-b5c4-f09a86302b97 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:08.620684 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.quota [None req-21df0d3b-26a5-44ad-b5c4-f09a86302b97 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Getting quotas for project 4ebf52e3718140d1b2e4883f8d5464f4. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 15:58:08.625035 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.quota [None req-21df0d3b-26a5-44ad-b5c4-f09a86302b97 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Getting quotas for user 72a393cb6b2343d697ec2e87d750c70a and project 4ebf52e3718140d1b2e4883f8d5464f4. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 15:58:08.639524 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-21df0d3b-26a5-44ad-b5c4-f09a86302b97 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 15:58:08.644213 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-21df0d3b-26a5-44ad-b5c4-f09a86302b97 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] [instance: 3caa011a-a4bf-43bc-a309-ec34a2ebe9dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cfe19284-9779-46f4-b458-81d5475ec82f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 15:58:08.698628 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-21df0d3b-26a5-44ad-b5c4-f09a86302b97 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.715104 Sep 07 15:58:08.699277 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 144/300] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Sep 7 15:58:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 15:58:08.710762 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d5bd3752-f85d-4d7d-9444-433d3ce575ad tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:08.711375 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d5bd3752-f85d-4d7d-9444-433d3ce575ad tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] [instance: 3caa011a-a4bf-43bc-a309-ec34a2ebe9dc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:08.787427 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d5bd3752-f85d-4d7d-9444-433d3ce575ad tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a393cb6b2343d697ec2e87d750c70a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf52e3718140d1b2e4883f8d5464f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:08.799675 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d5bd3752-f85d-4d7d-9444-433d3ce575ad tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] 10.222.0.17 "GET /compute/v2.1/servers/3caa011a-a4bf-43bc-a309-ec34a2ebe9dc" status: 200 len: 1214 microversion: 2.1 time: 0.092468 Sep 07 15:58:08.809453 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 157/301] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:08 2022] GET /compute/v2.1/servers/3caa011a-a4bf-43bc-a309-ec34a2ebe9dc => generated 1214 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:09.297720 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-588e680e-4293-4791-a27a-3b20fe3ef0a9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:09.298339 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-588e680e-4293-4791-a27a-3b20fe3ef0a9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: f39427e6-62a5-4a4e-96e8-644f03653722] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:09.321438 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-588e680e-4293-4791-a27a-3b20fe3ef0a9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:09.322187 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-588e680e-4293-4791-a27a-3b20fe3ef0a9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:09.322829 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-588e680e-4293-4791-a27a-3b20fe3ef0a9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:09.324030 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-588e680e-4293-4791-a27a-3b20fe3ef0a9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:09.324763 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-588e680e-4293-4791-a27a-3b20fe3ef0a9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:09.325754 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-588e680e-4293-4791-a27a-3b20fe3ef0a9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:09.518269 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-588e680e-4293-4791-a27a-3b20fe3ef0a9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:09.531616 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-588e680e-4293-4791-a27a-3b20fe3ef0a9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722" status: 200 len: 1521 microversion: 2.1 time: 0.239726 Sep 07 15:58:09.533378 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 145/302] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:09 2022] GET /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722 => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:09.824215 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ada19953-2a4d-4e0a-9c53-f5051cce7da5 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:09.824862 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ada19953-2a4d-4e0a-9c53-f5051cce7da5 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] [instance: 3caa011a-a4bf-43bc-a309-ec34a2ebe9dc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:09.835593 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ada19953-2a4d-4e0a-9c53-f5051cce7da5 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:09.836806 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ada19953-2a4d-4e0a-9c53-f5051cce7da5 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:09.838029 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ada19953-2a4d-4e0a-9c53-f5051cce7da5 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:09.840359 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ada19953-2a4d-4e0a-9c53-f5051cce7da5 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:09.842103 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ada19953-2a4d-4e0a-9c53-f5051cce7da5 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:09.845095 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ada19953-2a4d-4e0a-9c53-f5051cce7da5 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:09.920486 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ada19953-2a4d-4e0a-9c53-f5051cce7da5 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a393cb6b2343d697ec2e87d750c70a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf52e3718140d1b2e4883f8d5464f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:09.929224 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ada19953-2a4d-4e0a-9c53-f5051cce7da5 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] 10.222.0.17 "GET /compute/v2.1/servers/3caa011a-a4bf-43bc-a309-ec34a2ebe9dc" status: 200 len: 1266 microversion: 2.1 time: 0.107820 Sep 07 15:58:09.940581 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 158/303] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:09 2022] GET /compute/v2.1/servers/3caa011a-a4bf-43bc-a309-ec34a2ebe9dc => generated 1266 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:10.089011 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d56c6fb2-f813-49fa-9a60-0523c1967380 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-916063188", "imageRef": "cfe19284-9779-46f4-b458-81d5475ec82f", "flavorRef": "452"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:58:10.167093 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-d56c6fb2-f813-49fa-9a60-0523c1967380 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] validate_networks() for None {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 15:58:10.554452 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-efd9d79e-f3a0-4e3c-8043-ed82a1b50966 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:10.555059 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-efd9d79e-f3a0-4e3c-8043-ed82a1b50966 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: f39427e6-62a5-4a4e-96e8-644f03653722] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:10.560924 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efd9d79e-f3a0-4e3c-8043-ed82a1b50966 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:10.561403 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efd9d79e-f3a0-4e3c-8043-ed82a1b50966 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:10.561842 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efd9d79e-f3a0-4e3c-8043-ed82a1b50966 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:10.562527 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efd9d79e-f3a0-4e3c-8043-ed82a1b50966 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:10.562977 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efd9d79e-f3a0-4e3c-8043-ed82a1b50966 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:10.563418 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-efd9d79e-f3a0-4e3c-8043-ed82a1b50966 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:10.698824 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-efd9d79e-f3a0-4e3c-8043-ed82a1b50966 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:10.707174 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-efd9d79e-f3a0-4e3c-8043-ed82a1b50966 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722" status: 200 len: 1521 microversion: 2.1 time: 0.156566 Sep 07 15:58:10.707808 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 159/304] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:10 2022] GET /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:58:10.952417 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bf4d2213-f9c0-433e-8a94-22fac31ab048 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:10.953898 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bf4d2213-f9c0-433e-8a94-22fac31ab048 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] [instance: 3caa011a-a4bf-43bc-a309-ec34a2ebe9dc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:10.962557 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf4d2213-f9c0-433e-8a94-22fac31ab048 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:10.963043 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf4d2213-f9c0-433e-8a94-22fac31ab048 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:10.963963 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf4d2213-f9c0-433e-8a94-22fac31ab048 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:10.964679 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf4d2213-f9c0-433e-8a94-22fac31ab048 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:10.965129 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf4d2213-f9c0-433e-8a94-22fac31ab048 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:10.965565 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf4d2213-f9c0-433e-8a94-22fac31ab048 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:11.012176 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-d56c6fb2-f813-49fa-9a60-0523c1967380 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 15:58:11.012831 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-d56c6fb2-f813-49fa-9a60-0523c1967380 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 15:58:11.013355 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-d56c6fb2-f813-49fa-9a60-0523c1967380 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 15:58:11.014100 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-d56c6fb2-f813-49fa-9a60-0523c1967380 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 15:58:11.014657 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-d56c6fb2-f813-49fa-9a60-0523c1967380 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 15:58:11.032352 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d56c6fb2-f813-49fa-9a60-0523c1967380 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:11.033159 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d56c6fb2-f813-49fa-9a60-0523c1967380 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:11.033674 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d56c6fb2-f813-49fa-9a60-0523c1967380 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:11.034573 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d56c6fb2-f813-49fa-9a60-0523c1967380 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:11.035079 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d56c6fb2-f813-49fa-9a60-0523c1967380 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:11.035499 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d56c6fb2-f813-49fa-9a60-0523c1967380 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:11.043508 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=100 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:11.055169 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.quota [None req-d56c6fb2-f813-49fa-9a60-0523c1967380 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Getting quotas for project 0998ce41664645e6b2825dc435c8a4c2. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 15:58:11.058509 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-bf4d2213-f9c0-433e-8a94-22fac31ab048 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a393cb6b2343d697ec2e87d750c70a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf52e3718140d1b2e4883f8d5464f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:11.066050 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.quota [None req-d56c6fb2-f813-49fa-9a60-0523c1967380 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Getting quotas for user 055ae4012f414796a9a82e177ce43af7 and project 0998ce41664645e6b2825dc435c8a4c2. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 15:58:11.066559 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bf4d2213-f9c0-433e-8a94-22fac31ab048 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] 10.222.0.17 "GET /compute/v2.1/servers/3caa011a-a4bf-43bc-a309-ec34a2ebe9dc" status: 200 len: 1272 microversion: 2.1 time: 0.117900 Sep 07 15:58:11.067123 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 160/305] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:10 2022] GET /compute/v2.1/servers/3caa011a-a4bf-43bc-a309-ec34a2ebe9dc => generated 1272 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:58:11.080785 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d56c6fb2-f813-49fa-9a60-0523c1967380 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 15:58:11.083482 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d56c6fb2-f813-49fa-9a60-0523c1967380 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] [instance: 22b4fa04-91a6-4b41-8a11-c545bca344a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cfe19284-9779-46f4-b458-81d5475ec82f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 15:58:11.128989 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d56c6fb2-f813-49fa-9a60-0523c1967380 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.043964 Sep 07 15:58:11.136571 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 146/306] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Sep 7 15:58:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1047 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 15:58:11.144354 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3db8986a-a8c9-434b-99e3-d6ec41337af5 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:11.145087 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3db8986a-a8c9-434b-99e3-d6ec41337af5 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] [instance: 22b4fa04-91a6-4b41-8a11-c545bca344a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:11.217671 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3db8986a-a8c9-434b-99e3-d6ec41337af5 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ae4012f414796a9a82e177ce43af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0998ce41664645e6b2825dc435c8a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:11.225504 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3db8986a-a8c9-434b-99e3-d6ec41337af5 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] 10.222.0.17 "GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8" status: 200 len: 1214 microversion: 2.1 time: 0.087021 Sep 07 15:58:11.226352 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 161/307] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:11 2022] GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8 => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:58:11.731212 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-04037592-3792-49c1-9cd0-c4ae374ca101 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:11.732165 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-04037592-3792-49c1-9cd0-c4ae374ca101 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: f39427e6-62a5-4a4e-96e8-644f03653722] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:11.739795 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04037592-3792-49c1-9cd0-c4ae374ca101 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:11.740835 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04037592-3792-49c1-9cd0-c4ae374ca101 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:11.741367 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04037592-3792-49c1-9cd0-c4ae374ca101 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:11.742155 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04037592-3792-49c1-9cd0-c4ae374ca101 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:11.742815 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04037592-3792-49c1-9cd0-c4ae374ca101 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:11.743357 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04037592-3792-49c1-9cd0-c4ae374ca101 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:12.090177 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5afc7b80-b3e9-4b21-9f9b-89b896c1a7d8 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:12.090949 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5afc7b80-b3e9-4b21-9f9b-89b896c1a7d8 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] [instance: 3caa011a-a4bf-43bc-a309-ec34a2ebe9dc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:12.095933 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-04037592-3792-49c1-9cd0-c4ae374ca101 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:12.100642 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5afc7b80-b3e9-4b21-9f9b-89b896c1a7d8 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:12.101406 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5afc7b80-b3e9-4b21-9f9b-89b896c1a7d8 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:12.101825 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5afc7b80-b3e9-4b21-9f9b-89b896c1a7d8 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:12.102517 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5afc7b80-b3e9-4b21-9f9b-89b896c1a7d8 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:12.102961 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5afc7b80-b3e9-4b21-9f9b-89b896c1a7d8 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:12.105039 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5afc7b80-b3e9-4b21-9f9b-89b896c1a7d8 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:12.107250 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-04037592-3792-49c1-9cd0-c4ae374ca101 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722" status: 200 len: 1521 microversion: 2.1 time: 0.380577 Sep 07 15:58:12.109009 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 147/308] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:11 2022] GET /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722 => generated 1521 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:58:12.250107 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-49092254-df20-41a4-9762-d56cd72aa326 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:12.250808 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-49092254-df20-41a4-9762-d56cd72aa326 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] [instance: 22b4fa04-91a6-4b41-8a11-c545bca344a8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:12.256831 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-49092254-df20-41a4-9762-d56cd72aa326 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:12.257636 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-49092254-df20-41a4-9762-d56cd72aa326 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:12.258075 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-49092254-df20-41a4-9762-d56cd72aa326 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:12.258986 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-49092254-df20-41a4-9762-d56cd72aa326 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:12.259446 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-49092254-df20-41a4-9762-d56cd72aa326 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:12.259914 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-49092254-df20-41a4-9762-d56cd72aa326 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:12.305251 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5afc7b80-b3e9-4b21-9f9b-89b896c1a7d8 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a393cb6b2343d697ec2e87d750c70a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf52e3718140d1b2e4883f8d5464f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:12.314524 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5afc7b80-b3e9-4b21-9f9b-89b896c1a7d8 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] 10.222.0.17 "GET /compute/v2.1/servers/3caa011a-a4bf-43bc-a309-ec34a2ebe9dc" status: 200 len: 1314 microversion: 2.1 time: 0.227906 Sep 07 15:58:12.315101 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 162/309] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:12 2022] GET /compute/v2.1/servers/3caa011a-a4bf-43bc-a309-ec34a2ebe9dc => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:58:12.450547 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-49092254-df20-41a4-9762-d56cd72aa326 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ae4012f414796a9a82e177ce43af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0998ce41664645e6b2825dc435c8a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:12.465992 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-49092254-df20-41a4-9762-d56cd72aa326 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] 10.222.0.17 "GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8" status: 200 len: 1210 microversion: 2.1 time: 0.220258 Sep 07 15:58:12.467292 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 148/310] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:12 2022] GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8 => generated 1210 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:58:13.133293 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-502ae66f-0bbd-4c3a-a8c2-092f108d7ec1 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:13.135015 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-502ae66f-0bbd-4c3a-a8c2-092f108d7ec1 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: f39427e6-62a5-4a4e-96e8-644f03653722] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:13.142242 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-502ae66f-0bbd-4c3a-a8c2-092f108d7ec1 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:13.142915 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-502ae66f-0bbd-4c3a-a8c2-092f108d7ec1 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:13.143466 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-502ae66f-0bbd-4c3a-a8c2-092f108d7ec1 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:13.144282 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-502ae66f-0bbd-4c3a-a8c2-092f108d7ec1 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:13.144982 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-502ae66f-0bbd-4c3a-a8c2-092f108d7ec1 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:13.145812 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-502ae66f-0bbd-4c3a-a8c2-092f108d7ec1 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:13.330177 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-502ae66f-0bbd-4c3a-a8c2-092f108d7ec1 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:13.333914 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:13.339430 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-26a03062-7c74-4b55-af67-1e52734fbe74 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:13.340857 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-26a03062-7c74-4b55-af67-1e52734fbe74 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] [instance: 3caa011a-a4bf-43bc-a309-ec34a2ebe9dc] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:13.342252 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-502ae66f-0bbd-4c3a-a8c2-092f108d7ec1 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722" status: 200 len: 1521 microversion: 2.1 time: 0.213048 Sep 07 15:58:13.343356 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 163/311] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:13 2022] GET /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:13.359358 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-26a03062-7c74-4b55-af67-1e52734fbe74 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:13.359358 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-26a03062-7c74-4b55-af67-1e52734fbe74 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:13.359358 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-26a03062-7c74-4b55-af67-1e52734fbe74 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:13.359358 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-26a03062-7c74-4b55-af67-1e52734fbe74 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:13.359794 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-26a03062-7c74-4b55-af67-1e52734fbe74 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:13.359794 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-26a03062-7c74-4b55-af67-1e52734fbe74 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:13.493882 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ec1b5971-dde2-4224-a4aa-9b7c2fbf44de tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:13.494997 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ec1b5971-dde2-4224-a4aa-9b7c2fbf44de tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] [instance: 22b4fa04-91a6-4b41-8a11-c545bca344a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:13.505361 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec1b5971-dde2-4224-a4aa-9b7c2fbf44de tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:13.506182 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec1b5971-dde2-4224-a4aa-9b7c2fbf44de tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:13.506671 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec1b5971-dde2-4224-a4aa-9b7c2fbf44de tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:13.508322 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec1b5971-dde2-4224-a4aa-9b7c2fbf44de tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:13.508982 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec1b5971-dde2-4224-a4aa-9b7c2fbf44de tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:13.509768 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ec1b5971-dde2-4224-a4aa-9b7c2fbf44de tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:13.525584 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-26a03062-7c74-4b55-af67-1e52734fbe74 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a393cb6b2343d697ec2e87d750c70a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf52e3718140d1b2e4883f8d5464f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:13.539276 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-26a03062-7c74-4b55-af67-1e52734fbe74 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] 10.222.0.17 "GET /compute/v2.1/servers/3caa011a-a4bf-43bc-a309-ec34a2ebe9dc" status: 200 len: 1314 microversion: 2.1 time: 0.205338 Sep 07 15:58:13.540479 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 149/312] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:13 2022] GET /compute/v2.1/servers/3caa011a-a4bf-43bc-a309-ec34a2ebe9dc => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:13.587804 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ec1b5971-dde2-4224-a4aa-9b7c2fbf44de tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ae4012f414796a9a82e177ce43af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0998ce41664645e6b2825dc435c8a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:13.598019 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ec1b5971-dde2-4224-a4aa-9b7c2fbf44de tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] 10.222.0.17 "GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8" status: 200 len: 1210 microversion: 2.1 time: 0.110392 Sep 07 15:58:13.599013 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 164/313] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:13 2022] GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8 => generated 1210 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:58:14.366982 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9789c075-af1f-4bf4-ac59-489ca4efdaf0 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:14.367831 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9789c075-af1f-4bf4-ac59-489ca4efdaf0 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: f39427e6-62a5-4a4e-96e8-644f03653722] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:14.374942 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9789c075-af1f-4bf4-ac59-489ca4efdaf0 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:14.375822 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9789c075-af1f-4bf4-ac59-489ca4efdaf0 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:14.376333 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9789c075-af1f-4bf4-ac59-489ca4efdaf0 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:14.377150 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9789c075-af1f-4bf4-ac59-489ca4efdaf0 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:14.377827 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9789c075-af1f-4bf4-ac59-489ca4efdaf0 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:14.378498 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9789c075-af1f-4bf4-ac59-489ca4efdaf0 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:14.521926 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-9789c075-af1f-4bf4-ac59-489ca4efdaf0 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:14.534415 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9789c075-af1f-4bf4-ac59-489ca4efdaf0 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722" status: 200 len: 1521 microversion: 2.1 time: 0.168875 Sep 07 15:58:14.535434 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 150/314] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:14 2022] GET /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:14.563568 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0c6cbab2-deb1-4a2a-8332-bc8e11e34285 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:14.564399 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0c6cbab2-deb1-4a2a-8332-bc8e11e34285 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] [instance: 3caa011a-a4bf-43bc-a309-ec34a2ebe9dc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:14.571809 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c6cbab2-deb1-4a2a-8332-bc8e11e34285 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:14.572527 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c6cbab2-deb1-4a2a-8332-bc8e11e34285 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:14.573083 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c6cbab2-deb1-4a2a-8332-bc8e11e34285 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:14.573788 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c6cbab2-deb1-4a2a-8332-bc8e11e34285 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:14.574298 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c6cbab2-deb1-4a2a-8332-bc8e11e34285 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:14.574746 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c6cbab2-deb1-4a2a-8332-bc8e11e34285 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:14.624750 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5dac6c59-0c79-4a6a-bb91-371426fbbba4 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:14.626661 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5dac6c59-0c79-4a6a-bb91-371426fbbba4 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] [instance: 22b4fa04-91a6-4b41-8a11-c545bca344a8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:14.636251 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5dac6c59-0c79-4a6a-bb91-371426fbbba4 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:14.636793 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5dac6c59-0c79-4a6a-bb91-371426fbbba4 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:14.637242 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5dac6c59-0c79-4a6a-bb91-371426fbbba4 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:14.638079 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5dac6c59-0c79-4a6a-bb91-371426fbbba4 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:14.638953 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5dac6c59-0c79-4a6a-bb91-371426fbbba4 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:14.639391 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5dac6c59-0c79-4a6a-bb91-371426fbbba4 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:14.721233 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-5dac6c59-0c79-4a6a-bb91-371426fbbba4 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ae4012f414796a9a82e177ce43af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0998ce41664645e6b2825dc435c8a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:14.734554 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5dac6c59-0c79-4a6a-bb91-371426fbbba4 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] 10.222.0.17 "GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8" status: 200 len: 1210 microversion: 2.1 time: 0.115509 Sep 07 15:58:14.735768 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 151/315] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:14 2022] GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8 => generated 1210 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:14.809933 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-0c6cbab2-deb1-4a2a-8332-bc8e11e34285 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a393cb6b2343d697ec2e87d750c70a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf52e3718140d1b2e4883f8d5464f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:14.819307 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0c6cbab2-deb1-4a2a-8332-bc8e11e34285 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] 10.222.0.17 "GET /compute/v2.1/servers/3caa011a-a4bf-43bc-a309-ec34a2ebe9dc" status: 200 len: 1314 microversion: 2.1 time: 0.259970 Sep 07 15:58:14.820083 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 165/316] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:14 2022] GET /compute/v2.1/servers/3caa011a-a4bf-43bc-a309-ec34a2ebe9dc => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:15.562691 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-81d4311e-b68a-4f15-a3f5-636f9fd78151 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:15.563384 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-81d4311e-b68a-4f15-a3f5-636f9fd78151 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: f39427e6-62a5-4a4e-96e8-644f03653722] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:15.573911 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-81d4311e-b68a-4f15-a3f5-636f9fd78151 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:15.574408 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-81d4311e-b68a-4f15-a3f5-636f9fd78151 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:15.574849 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-81d4311e-b68a-4f15-a3f5-636f9fd78151 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:15.575591 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-81d4311e-b68a-4f15-a3f5-636f9fd78151 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:15.576061 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-81d4311e-b68a-4f15-a3f5-636f9fd78151 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:15.576493 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-81d4311e-b68a-4f15-a3f5-636f9fd78151 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:15.760210 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-15ade057-f484-4f56-85fe-22893e674f65 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:15.762023 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-15ade057-f484-4f56-85fe-22893e674f65 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] [instance: 22b4fa04-91a6-4b41-8a11-c545bca344a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:15.774745 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15ade057-f484-4f56-85fe-22893e674f65 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:15.776761 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15ade057-f484-4f56-85fe-22893e674f65 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:15.778153 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15ade057-f484-4f56-85fe-22893e674f65 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:15.780619 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15ade057-f484-4f56-85fe-22893e674f65 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:15.781451 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15ade057-f484-4f56-85fe-22893e674f65 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:15.782434 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15ade057-f484-4f56-85fe-22893e674f65 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:15.872086 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-15ade057-f484-4f56-85fe-22893e674f65 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ae4012f414796a9a82e177ce43af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0998ce41664645e6b2825dc435c8a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:15.883113 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-15ade057-f484-4f56-85fe-22893e674f65 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] 10.222.0.17 "GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8" status: 200 len: 1266 microversion: 2.1 time: 0.128252 Sep 07 15:58:15.883717 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 166/317] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:15 2022] GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8 => generated 1266 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:58:15.895855 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c9e95e8e-6ea4-420f-a6b0-4cb22d95f197 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:15.898676 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c9e95e8e-6ea4-420f-a6b0-4cb22d95f197 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] [instance: 3caa011a-a4bf-43bc-a309-ec34a2ebe9dc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:15.905734 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9e95e8e-6ea4-420f-a6b0-4cb22d95f197 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:15.906800 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9e95e8e-6ea4-420f-a6b0-4cb22d95f197 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:15.907060 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9e95e8e-6ea4-420f-a6b0-4cb22d95f197 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:15.907811 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9e95e8e-6ea4-420f-a6b0-4cb22d95f197 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:15.908470 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9e95e8e-6ea4-420f-a6b0-4cb22d95f197 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:15.908910 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9e95e8e-6ea4-420f-a6b0-4cb22d95f197 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:16.010474 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-81d4311e-b68a-4f15-a3f5-636f9fd78151 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:16.021102 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-81d4311e-b68a-4f15-a3f5-636f9fd78151 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722" status: 200 len: 1521 microversion: 2.1 time: 0.462490 Sep 07 15:58:16.035696 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 152/318] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:15 2022] GET /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722 => generated 1521 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:16.113115 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c9e95e8e-6ea4-420f-a6b0-4cb22d95f197 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a393cb6b2343d697ec2e87d750c70a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf52e3718140d1b2e4883f8d5464f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:16.127019 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c9e95e8e-6ea4-420f-a6b0-4cb22d95f197 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] 10.222.0.17 "GET /compute/v2.1/servers/3caa011a-a4bf-43bc-a309-ec34a2ebe9dc" status: 200 len: 1314 microversion: 2.1 time: 0.241884 Sep 07 15:58:16.128177 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 167/319] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:15 2022] GET /compute/v2.1/servers/3caa011a-a4bf-43bc-a309-ec34a2ebe9dc => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:16.910154 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d9acf4ad-c6fc-4ba7-9b3a-e3fa56f93564 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:16.911659 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d9acf4ad-c6fc-4ba7-9b3a-e3fa56f93564 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] [instance: 22b4fa04-91a6-4b41-8a11-c545bca344a8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:16.922295 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d9acf4ad-c6fc-4ba7-9b3a-e3fa56f93564 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:16.922882 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d9acf4ad-c6fc-4ba7-9b3a-e3fa56f93564 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:16.923257 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d9acf4ad-c6fc-4ba7-9b3a-e3fa56f93564 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:16.924024 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d9acf4ad-c6fc-4ba7-9b3a-e3fa56f93564 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:16.925996 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d9acf4ad-c6fc-4ba7-9b3a-e3fa56f93564 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:16.926422 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d9acf4ad-c6fc-4ba7-9b3a-e3fa56f93564 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:17.030327 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-d9acf4ad-c6fc-4ba7-9b3a-e3fa56f93564 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ae4012f414796a9a82e177ce43af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0998ce41664645e6b2825dc435c8a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:17.049772 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-57994d28-625f-453f-9de7-db779cde4f62 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:17.050380 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-57994d28-625f-453f-9de7-db779cde4f62 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: f39427e6-62a5-4a4e-96e8-644f03653722] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:17.050659 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d9acf4ad-c6fc-4ba7-9b3a-e3fa56f93564 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] 10.222.0.17 "GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8" status: 200 len: 1272 microversion: 2.1 time: 0.146309 Sep 07 15:58:17.059931 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-57994d28-625f-453f-9de7-db779cde4f62 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:17.060768 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 153/320] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:16 2022] GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8 => generated 1272 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:17.064140 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-57994d28-625f-453f-9de7-db779cde4f62 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:17.064845 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-57994d28-625f-453f-9de7-db779cde4f62 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:17.065937 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-57994d28-625f-453f-9de7-db779cde4f62 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:17.067123 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-57994d28-625f-453f-9de7-db779cde4f62 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:17.068136 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-57994d28-625f-453f-9de7-db779cde4f62 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:17.150519 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-21eacc30-b498-4d9a-a0e6-1cd47ba6c762 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:17.151131 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-21eacc30-b498-4d9a-a0e6-1cd47ba6c762 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] [instance: 3caa011a-a4bf-43bc-a309-ec34a2ebe9dc] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:17.182988 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-21eacc30-b498-4d9a-a0e6-1cd47ba6c762 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:17.191605 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-21eacc30-b498-4d9a-a0e6-1cd47ba6c762 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:17.192644 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-21eacc30-b498-4d9a-a0e6-1cd47ba6c762 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:17.196314 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-21eacc30-b498-4d9a-a0e6-1cd47ba6c762 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:17.210020 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-21eacc30-b498-4d9a-a0e6-1cd47ba6c762 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:17.210020 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-21eacc30-b498-4d9a-a0e6-1cd47ba6c762 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:17.431512 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-57994d28-625f-453f-9de7-db779cde4f62 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:17.447317 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-57994d28-625f-453f-9de7-db779cde4f62 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722" status: 200 len: 1521 microversion: 2.1 time: 0.403829 Sep 07 15:58:17.448310 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 168/321] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:17 2022] GET /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722 => generated 1521 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:17.455220 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-d7d831e4-1d33-4559-a4ca-7557b6f1fc23 req-d62e01c9-15e2-47a5-bdb5-29ff5f98f906 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3caa011a-a4bf-43bc-a309-ec34a2ebe9dc", "tag": "090e856b-d04b-4dd3-9916-324029e8faf2"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:58:17.477970 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d7d831e4-1d33-4559-a4ca-7557b6f1fc23 req-d62e01c9-15e2-47a5-bdb5-29ff5f98f906 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:17.478687 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d7d831e4-1d33-4559-a4ca-7557b6f1fc23 req-d62e01c9-15e2-47a5-bdb5-29ff5f98f906 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:17.479302 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d7d831e4-1d33-4559-a4ca-7557b6f1fc23 req-d62e01c9-15e2-47a5-bdb5-29ff5f98f906 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:17.497523 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-d7d831e4-1d33-4559-a4ca-7557b6f1fc23 req-d62e01c9-15e2-47a5-bdb5-29ff5f98f906 service nova] Creating event network-changed:090e856b-d04b-4dd3-9916-324029e8faf2 for instance 3caa011a-a4bf-43bc-a309-ec34a2ebe9dc on hv-cinder-85331 Sep 07 15:58:17.517199 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-d7d831e4-1d33-4559-a4ca-7557b6f1fc23 req-d62e01c9-15e2-47a5-bdb5-29ff5f98f906 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067570 Sep 07 15:58:17.518054 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 169/322] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 15:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:58:17.974303 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-21eacc30-b498-4d9a-a0e6-1cd47ba6c762 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a393cb6b2343d697ec2e87d750c70a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf52e3718140d1b2e4883f8d5464f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:17.998070 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-21eacc30-b498-4d9a-a0e6-1cd47ba6c762 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] 10.222.0.17 "GET /compute/v2.1/servers/3caa011a-a4bf-43bc-a309-ec34a2ebe9dc" status: 200 len: 1314 microversion: 2.1 time: 0.848288 Sep 07 15:58:17.999498 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 154/323] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:17 2022] GET /compute/v2.1/servers/3caa011a-a4bf-43bc-a309-ec34a2ebe9dc => generated 1314 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:58:18.080145 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7177e946-dd98-4046-bc51-1a60fbb9c24c tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:18.081701 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7177e946-dd98-4046-bc51-1a60fbb9c24c tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] [instance: 22b4fa04-91a6-4b41-8a11-c545bca344a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:18.129909 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7177e946-dd98-4046-bc51-1a60fbb9c24c tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:18.130529 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7177e946-dd98-4046-bc51-1a60fbb9c24c tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:18.130978 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7177e946-dd98-4046-bc51-1a60fbb9c24c tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:18.131726 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7177e946-dd98-4046-bc51-1a60fbb9c24c tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:18.153602 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7177e946-dd98-4046-bc51-1a60fbb9c24c tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:18.154434 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7177e946-dd98-4046-bc51-1a60fbb9c24c tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:18.471740 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7a4268ba-25fd-4a76-8c35-bf1abff2b497 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:18.472654 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7a4268ba-25fd-4a76-8c35-bf1abff2b497 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: f39427e6-62a5-4a4e-96e8-644f03653722] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:18.481868 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a4268ba-25fd-4a76-8c35-bf1abff2b497 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:18.482651 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a4268ba-25fd-4a76-8c35-bf1abff2b497 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:18.483902 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a4268ba-25fd-4a76-8c35-bf1abff2b497 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:18.484889 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a4268ba-25fd-4a76-8c35-bf1abff2b497 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:18.485551 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a4268ba-25fd-4a76-8c35-bf1abff2b497 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:18.486186 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7a4268ba-25fd-4a76-8c35-bf1abff2b497 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:18.489606 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7177e946-dd98-4046-bc51-1a60fbb9c24c tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ae4012f414796a9a82e177ce43af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0998ce41664645e6b2825dc435c8a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:18.504139 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7177e946-dd98-4046-bc51-1a60fbb9c24c tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] 10.222.0.17 "GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8" status: 200 len: 1314 microversion: 2.1 time: 0.432938 Sep 07 15:58:18.505184 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 170/324] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:18 2022] GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8 => generated 1314 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:18.732483 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-7a4268ba-25fd-4a76-8c35-bf1abff2b497 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:18.742298 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7a4268ba-25fd-4a76-8c35-bf1abff2b497 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722" status: 200 len: 1521 microversion: 2.1 time: 0.275183 Sep 07 15:58:18.743260 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 155/325] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:18 2022] GET /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722 => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:19.026624 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-13a6a9ce-088e-49dc-9587-232a37051476 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:19.027528 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-13a6a9ce-088e-49dc-9587-232a37051476 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] [instance: 3caa011a-a4bf-43bc-a309-ec34a2ebe9dc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:19.035324 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-13a6a9ce-088e-49dc-9587-232a37051476 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:19.035889 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-13a6a9ce-088e-49dc-9587-232a37051476 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:19.036788 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-13a6a9ce-088e-49dc-9587-232a37051476 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:19.037719 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-13a6a9ce-088e-49dc-9587-232a37051476 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:19.038588 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-13a6a9ce-088e-49dc-9587-232a37051476 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:19.039217 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-13a6a9ce-088e-49dc-9587-232a37051476 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:19.046134 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-a991b945-7bdf-4dac-bfcf-65e9e6bcd2ed req-46f60807-be4f-4233-b198-e7a9eb3b47e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22b4fa04-91a6-4b41-8a11-c545bca344a8", "tag": "ec56e8a9-c5e3-4861-bb4b-5279a8fb5849"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:58:19.060076 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-a991b945-7bdf-4dac-bfcf-65e9e6bcd2ed req-46f60807-be4f-4233-b198-e7a9eb3b47e9 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:19.065081 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-a991b945-7bdf-4dac-bfcf-65e9e6bcd2ed req-46f60807-be4f-4233-b198-e7a9eb3b47e9 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:19.065738 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-a991b945-7bdf-4dac-bfcf-65e9e6bcd2ed req-46f60807-be4f-4233-b198-e7a9eb3b47e9 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:19.086649 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-a991b945-7bdf-4dac-bfcf-65e9e6bcd2ed req-46f60807-be4f-4233-b198-e7a9eb3b47e9 service nova] Creating event network-changed:ec56e8a9-c5e3-4861-bb4b-5279a8fb5849 for instance 22b4fa04-91a6-4b41-8a11-c545bca344a8 on hv-cinder-85331 Sep 07 15:58:19.092322 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-a991b945-7bdf-4dac-bfcf-65e9e6bcd2ed req-46f60807-be4f-4233-b198-e7a9eb3b47e9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049731 Sep 07 15:58:19.094056 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 156/326] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 15:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:58:19.252037 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-13a6a9ce-088e-49dc-9587-232a37051476 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a393cb6b2343d697ec2e87d750c70a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf52e3718140d1b2e4883f8d5464f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:19.262593 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-13a6a9ce-088e-49dc-9587-232a37051476 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] 10.222.0.17 "GET /compute/v2.1/servers/3caa011a-a4bf-43bc-a309-ec34a2ebe9dc" status: 200 len: 1314 microversion: 2.1 time: 0.241109 Sep 07 15:58:19.263835 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 171/327] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:19 2022] GET /compute/v2.1/servers/3caa011a-a4bf-43bc-a309-ec34a2ebe9dc => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:19.528015 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4f3cf410-23b1-4a78-ab7e-9a1c3eaabfdb tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:19.529064 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4f3cf410-23b1-4a78-ab7e-9a1c3eaabfdb tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] [instance: 22b4fa04-91a6-4b41-8a11-c545bca344a8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:19.541216 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4f3cf410-23b1-4a78-ab7e-9a1c3eaabfdb tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:19.542026 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4f3cf410-23b1-4a78-ab7e-9a1c3eaabfdb tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:19.543061 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4f3cf410-23b1-4a78-ab7e-9a1c3eaabfdb tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:19.545064 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4f3cf410-23b1-4a78-ab7e-9a1c3eaabfdb tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:19.546535 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4f3cf410-23b1-4a78-ab7e-9a1c3eaabfdb tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:19.547166 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4f3cf410-23b1-4a78-ab7e-9a1c3eaabfdb tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:19.767230 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a4680a71-136d-423a-8043-216dcc6ce942 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:19.768023 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a4680a71-136d-423a-8043-216dcc6ce942 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: f39427e6-62a5-4a4e-96e8-644f03653722] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:19.775334 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a4680a71-136d-423a-8043-216dcc6ce942 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:19.776251 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a4680a71-136d-423a-8043-216dcc6ce942 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:19.776913 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a4680a71-136d-423a-8043-216dcc6ce942 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:19.777867 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a4680a71-136d-423a-8043-216dcc6ce942 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:19.778557 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a4680a71-136d-423a-8043-216dcc6ce942 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:19.779075 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a4680a71-136d-423a-8043-216dcc6ce942 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:19.804693 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-4f3cf410-23b1-4a78-ab7e-9a1c3eaabfdb tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ae4012f414796a9a82e177ce43af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0998ce41664645e6b2825dc435c8a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:19.819196 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4f3cf410-23b1-4a78-ab7e-9a1c3eaabfdb tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] 10.222.0.17 "GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8" status: 200 len: 1314 microversion: 2.1 time: 0.296124 Sep 07 15:58:19.827723 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 157/328] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:19 2022] GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8 => generated 1314 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:20.064820 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a4680a71-136d-423a-8043-216dcc6ce942 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:20.076413 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a4680a71-136d-423a-8043-216dcc6ce942 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722" status: 200 len: 1521 microversion: 2.1 time: 0.313907 Sep 07 15:58:20.077040 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 172/329] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:19 2022] GET /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722 => generated 1521 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:20.286038 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d2ea68db-adf3-4951-b4d6-8c4280ad57bb tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:20.286557 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d2ea68db-adf3-4951-b4d6-8c4280ad57bb tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] [instance: 3caa011a-a4bf-43bc-a309-ec34a2ebe9dc] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:20.293634 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2ea68db-adf3-4951-b4d6-8c4280ad57bb tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:20.294364 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2ea68db-adf3-4951-b4d6-8c4280ad57bb tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:20.294762 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2ea68db-adf3-4951-b4d6-8c4280ad57bb tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:20.295501 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2ea68db-adf3-4951-b4d6-8c4280ad57bb tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:20.296142 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2ea68db-adf3-4951-b4d6-8c4280ad57bb tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:20.296752 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2ea68db-adf3-4951-b4d6-8c4280ad57bb tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:20.565880 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-d2ea68db-adf3-4951-b4d6-8c4280ad57bb tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a393cb6b2343d697ec2e87d750c70a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf52e3718140d1b2e4883f8d5464f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:20.579785 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d2ea68db-adf3-4951-b4d6-8c4280ad57bb tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] 10.222.0.17 "GET /compute/v2.1/servers/3caa011a-a4bf-43bc-a309-ec34a2ebe9dc" status: 200 len: 1314 microversion: 2.1 time: 0.297400 Sep 07 15:58:20.591629 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 158/330] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:20 2022] GET /compute/v2.1/servers/3caa011a-a4bf-43bc-a309-ec34a2ebe9dc => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:20.851672 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-62cb1b01-22ef-4f5e-a176-ca4766375a0d tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:20.853518 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-62cb1b01-22ef-4f5e-a176-ca4766375a0d tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] [instance: 22b4fa04-91a6-4b41-8a11-c545bca344a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:20.862487 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62cb1b01-22ef-4f5e-a176-ca4766375a0d tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:20.865037 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62cb1b01-22ef-4f5e-a176-ca4766375a0d tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:20.865527 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62cb1b01-22ef-4f5e-a176-ca4766375a0d tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:20.866299 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62cb1b01-22ef-4f5e-a176-ca4766375a0d tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:20.866764 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62cb1b01-22ef-4f5e-a176-ca4766375a0d tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:20.867217 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62cb1b01-22ef-4f5e-a176-ca4766375a0d tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:21.053801 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-62cb1b01-22ef-4f5e-a176-ca4766375a0d tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ae4012f414796a9a82e177ce43af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0998ce41664645e6b2825dc435c8a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:21.062499 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-62cb1b01-22ef-4f5e-a176-ca4766375a0d tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] 10.222.0.17 "GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8" status: 200 len: 1314 microversion: 2.1 time: 0.216030 Sep 07 15:58:21.076328 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 173/331] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:20 2022] GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:21.103749 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3a9cd802-003e-4f91-b3d7-5c23bb4774f5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:21.104461 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3a9cd802-003e-4f91-b3d7-5c23bb4774f5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: f39427e6-62a5-4a4e-96e8-644f03653722] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:21.112254 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=4 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:21.113867 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=12 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:21.115934 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3a9cd802-003e-4f91-b3d7-5c23bb4774f5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:21.117142 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3a9cd802-003e-4f91-b3d7-5c23bb4774f5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:21.118343 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3a9cd802-003e-4f91-b3d7-5c23bb4774f5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:21.119530 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3a9cd802-003e-4f91-b3d7-5c23bb4774f5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:21.120637 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3a9cd802-003e-4f91-b3d7-5c23bb4774f5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:21.121265 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3a9cd802-003e-4f91-b3d7-5c23bb4774f5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:21.246160 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=4 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:21.345841 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-3a9cd802-003e-4f91-b3d7-5c23bb4774f5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:21.359230 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3a9cd802-003e-4f91-b3d7-5c23bb4774f5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722" status: 200 len: 1521 microversion: 2.1 time: 0.261914 Sep 07 15:58:21.359929 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 159/332] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:21 2022] GET /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:21.438376 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-470a761a-a0e6-4189-a8d6-ada67c9a79f2 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Action: 'create', calling method: .version_select at 0x7ff9a5da8160>, body: {"keypair": {"name": "tempest-keypair-1756071938", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUK7dmuxPIZ41d0Z9U1rlAsraa0cIVRFir+al/6TZ0PewXHddcyFryGBCSRAIKxb///fM/83J0F4wvLffvQjAAszWNYiZuYe2Al8Rdlgtan345JksApeNuzdyxvHfp1Zw=="}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:58:21.504808 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-470a761a-a0e6-4189-a8d6-ada67c9a79f2 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Getting quotas for project a446dbd47db84c4987a3ee5332356b84. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 15:58:21.513155 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-470a761a-a0e6-4189-a8d6-ada67c9a79f2 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Getting quotas for user 2fcfbaf5bab14a4783ca912a222341c0 and project a446dbd47db84c4987a3ee5332356b84. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 15:58:21.608002 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a672530b-89fd-4a17-9cb3-9ff24d61f4e9 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:21.609143 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a672530b-89fd-4a17-9cb3-9ff24d61f4e9 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] [instance: 3caa011a-a4bf-43bc-a309-ec34a2ebe9dc] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:21.626575 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a672530b-89fd-4a17-9cb3-9ff24d61f4e9 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:21.627466 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a672530b-89fd-4a17-9cb3-9ff24d61f4e9 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:21.629269 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a672530b-89fd-4a17-9cb3-9ff24d61f4e9 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:21.629882 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-470a761a-a0e6-4189-a8d6-ada67c9a79f2 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.396482 Sep 07 15:58:21.630864 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a672530b-89fd-4a17-9cb3-9ff24d61f4e9 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:21.631783 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a672530b-89fd-4a17-9cb3-9ff24d61f4e9 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:21.634042 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 174/333] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Sep 7 15:58:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:58:21.636327 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a672530b-89fd-4a17-9cb3-9ff24d61f4e9 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:21.914870 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-a672530b-89fd-4a17-9cb3-9ff24d61f4e9 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a393cb6b2343d697ec2e87d750c70a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf52e3718140d1b2e4883f8d5464f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:21.923208 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a672530b-89fd-4a17-9cb3-9ff24d61f4e9 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] 10.222.0.17 "GET /compute/v2.1/servers/3caa011a-a4bf-43bc-a309-ec34a2ebe9dc" status: 200 len: 1314 microversion: 2.1 time: 0.322624 Sep 07 15:58:21.927908 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 160/334] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:21 2022] GET /compute/v2.1/servers/3caa011a-a4bf-43bc-a309-ec34a2ebe9dc => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:22.092717 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-008b3556-b169-4672-a684-404de7c3f897 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:22.098661 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-008b3556-b169-4672-a684-404de7c3f897 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] [instance: 22b4fa04-91a6-4b41-8a11-c545bca344a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:22.114871 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-008b3556-b169-4672-a684-404de7c3f897 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:22.115931 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-008b3556-b169-4672-a684-404de7c3f897 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:22.116919 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-008b3556-b169-4672-a684-404de7c3f897 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:22.118333 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-008b3556-b169-4672-a684-404de7c3f897 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:22.119874 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-008b3556-b169-4672-a684-404de7c3f897 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:22.120750 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-008b3556-b169-4672-a684-404de7c3f897 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:22.382256 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8bfe018f-c070-4815-922a-c1fddc0113f3 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:22.382866 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8bfe018f-c070-4815-922a-c1fddc0113f3 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: f39427e6-62a5-4a4e-96e8-644f03653722] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:22.403091 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8bfe018f-c070-4815-922a-c1fddc0113f3 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:22.403614 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8bfe018f-c070-4815-922a-c1fddc0113f3 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:22.404054 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8bfe018f-c070-4815-922a-c1fddc0113f3 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:22.404797 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8bfe018f-c070-4815-922a-c1fddc0113f3 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:22.405260 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8bfe018f-c070-4815-922a-c1fddc0113f3 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:22.405684 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8bfe018f-c070-4815-922a-c1fddc0113f3 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:22.643401 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-8bfe018f-c070-4815-922a-c1fddc0113f3 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:22.653453 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8bfe018f-c070-4815-922a-c1fddc0113f3 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722" status: 200 len: 1521 microversion: 2.1 time: 0.274978 Sep 07 15:58:22.655756 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 161/335] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:22 2022] GET /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722 => generated 1521 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:58:22.807208 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-008b3556-b169-4672-a684-404de7c3f897 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ae4012f414796a9a82e177ce43af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0998ce41664645e6b2825dc435c8a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:22.819715 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-008b3556-b169-4672-a684-404de7c3f897 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] 10.222.0.17 "GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8" status: 200 len: 1314 microversion: 2.1 time: 0.735335 Sep 07 15:58:22.821023 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 175/336] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:22 2022] GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8 => generated 1314 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:22.962612 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-956942b5-3315-4623-bac9-2da26816c5d8 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:22.963232 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-956942b5-3315-4623-bac9-2da26816c5d8 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] [instance: 3caa011a-a4bf-43bc-a309-ec34a2ebe9dc] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:22.969536 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-956942b5-3315-4623-bac9-2da26816c5d8 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:22.970028 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-956942b5-3315-4623-bac9-2da26816c5d8 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:22.970462 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-956942b5-3315-4623-bac9-2da26816c5d8 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:22.971165 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-956942b5-3315-4623-bac9-2da26816c5d8 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:22.971664 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-956942b5-3315-4623-bac9-2da26816c5d8 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:22.972302 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-956942b5-3315-4623-bac9-2da26816c5d8 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:23.171049 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-956942b5-3315-4623-bac9-2da26816c5d8 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a393cb6b2343d697ec2e87d750c70a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf52e3718140d1b2e4883f8d5464f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:23.182308 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-956942b5-3315-4623-bac9-2da26816c5d8 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] 10.222.0.17 "GET /compute/v2.1/servers/3caa011a-a4bf-43bc-a309-ec34a2ebe9dc" status: 200 len: 1314 microversion: 2.1 time: 0.223704 Sep 07 15:58:23.182969 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 162/337] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:22 2022] GET /compute/v2.1/servers/3caa011a-a4bf-43bc-a309-ec34a2ebe9dc => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:23.685135 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9bc240b4-2621-4883-91ff-78c9d1d7411f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:23.685818 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9bc240b4-2621-4883-91ff-78c9d1d7411f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: f39427e6-62a5-4a4e-96e8-644f03653722] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:23.698648 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9bc240b4-2621-4883-91ff-78c9d1d7411f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:23.699143 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9bc240b4-2621-4883-91ff-78c9d1d7411f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:23.699602 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9bc240b4-2621-4883-91ff-78c9d1d7411f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:23.700785 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9bc240b4-2621-4883-91ff-78c9d1d7411f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:23.701238 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9bc240b4-2621-4883-91ff-78c9d1d7411f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:23.703079 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9bc240b4-2621-4883-91ff-78c9d1d7411f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:23.845813 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e1283a5e-4dd9-4e24-a829-1b27b361a657 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:23.847036 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e1283a5e-4dd9-4e24-a829-1b27b361a657 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] [instance: 22b4fa04-91a6-4b41-8a11-c545bca344a8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:23.854935 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e1283a5e-4dd9-4e24-a829-1b27b361a657 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:23.855428 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e1283a5e-4dd9-4e24-a829-1b27b361a657 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:23.856182 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e1283a5e-4dd9-4e24-a829-1b27b361a657 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:23.856893 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e1283a5e-4dd9-4e24-a829-1b27b361a657 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:23.857354 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e1283a5e-4dd9-4e24-a829-1b27b361a657 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:23.858341 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e1283a5e-4dd9-4e24-a829-1b27b361a657 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:24.166231 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-e1283a5e-4dd9-4e24-a829-1b27b361a657 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ae4012f414796a9a82e177ce43af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0998ce41664645e6b2825dc435c8a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:24.177348 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e1283a5e-4dd9-4e24-a829-1b27b361a657 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] 10.222.0.17 "GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8" status: 200 len: 1314 microversion: 2.1 time: 0.335810 Sep 07 15:58:24.191991 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 163/338] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:23 2022] GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8 => generated 1314 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:24.218177 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2d8de636-0b7d-4ea4-9001-80e1b2cc012a tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:24.219776 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2d8de636-0b7d-4ea4-9001-80e1b2cc012a tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] [instance: 3caa011a-a4bf-43bc-a309-ec34a2ebe9dc] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:24.232113 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2d8de636-0b7d-4ea4-9001-80e1b2cc012a tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:24.232875 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2d8de636-0b7d-4ea4-9001-80e1b2cc012a tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:24.233733 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2d8de636-0b7d-4ea4-9001-80e1b2cc012a tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:24.247238 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2d8de636-0b7d-4ea4-9001-80e1b2cc012a tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:24.248861 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2d8de636-0b7d-4ea4-9001-80e1b2cc012a tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:24.249628 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2d8de636-0b7d-4ea4-9001-80e1b2cc012a tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:24.259258 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=100 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:24.265405 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9bc240b4-2621-4883-91ff-78c9d1d7411f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:24.284763 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9bc240b4-2621-4883-91ff-78c9d1d7411f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722" status: 200 len: 1521 microversion: 2.1 time: 0.607166 Sep 07 15:58:24.299973 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 176/339] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:23 2022] GET /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722 => generated 1521 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:24.519832 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-2d8de636-0b7d-4ea4-9001-80e1b2cc012a tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a393cb6b2343d697ec2e87d750c70a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf52e3718140d1b2e4883f8d5464f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:24.532161 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2d8de636-0b7d-4ea4-9001-80e1b2cc012a tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] 10.222.0.17 "GET /compute/v2.1/servers/3caa011a-a4bf-43bc-a309-ec34a2ebe9dc" status: 200 len: 1314 microversion: 2.1 time: 0.320248 Sep 07 15:58:24.533616 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 164/340] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:24 2022] GET /compute/v2.1/servers/3caa011a-a4bf-43bc-a309-ec34a2ebe9dc => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:24.585460 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-6cfcbfe3-4ba4-4909-ac1b-41a72f3a27cc req-c8c3b286-e62f-49bc-ba63-33a01c22b375 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3caa011a-a4bf-43bc-a309-ec34a2ebe9dc", "name": "network-vif-plugged", "status": "completed", "tag": "090e856b-d04b-4dd3-9916-324029e8faf2"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:58:24.601971 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-6cfcbfe3-4ba4-4909-ac1b-41a72f3a27cc req-c8c3b286-e62f-49bc-ba63-33a01c22b375 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:24.602457 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-6cfcbfe3-4ba4-4909-ac1b-41a72f3a27cc req-c8c3b286-e62f-49bc-ba63-33a01c22b375 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:24.602891 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-6cfcbfe3-4ba4-4909-ac1b-41a72f3a27cc req-c8c3b286-e62f-49bc-ba63-33a01c22b375 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:24.626562 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-6cfcbfe3-4ba4-4909-ac1b-41a72f3a27cc req-c8c3b286-e62f-49bc-ba63-33a01c22b375 service nova] Creating event network-vif-plugged:090e856b-d04b-4dd3-9916-324029e8faf2 for instance 3caa011a-a4bf-43bc-a309-ec34a2ebe9dc on hv-cinder-85331 Sep 07 15:58:24.635802 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-6cfcbfe3-4ba4-4909-ac1b-41a72f3a27cc req-c8c3b286-e62f-49bc-ba63-33a01c22b375 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054735 Sep 07 15:58:24.637242 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 177/341] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 15:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:58:24.685569 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2d63e47a-bc15-4330-94f3-cd5b968a85da tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1645922790", "imageRef": "cfe19284-9779-46f4-b458-81d5475ec82f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0ef9703b-8e10-4c6e-afbd-fe54751cee86"}], "security_groups": [{"name": "tempest-securitygroup--1086577866"}], "key_name": "tempest-keypair-1756071938", "user_data": "}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:58:24.839284 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-2d63e47a-bc15-4330-94f3-cd5b968a85da tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] validate_networks() for [('0ef9703b-8e10-4c6e-afbd-fe54751cee86', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 15:58:25.204417 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2a7aa5c5-ef9b-4068-9e70-c5f25acd5578 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:25.205776 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2a7aa5c5-ef9b-4068-9e70-c5f25acd5578 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] [instance: 22b4fa04-91a6-4b41-8a11-c545bca344a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:25.221013 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a7aa5c5-ef9b-4068-9e70-c5f25acd5578 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:25.221796 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a7aa5c5-ef9b-4068-9e70-c5f25acd5578 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:25.223978 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a7aa5c5-ef9b-4068-9e70-c5f25acd5578 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:25.224978 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a7aa5c5-ef9b-4068-9e70-c5f25acd5578 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:25.228159 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a7aa5c5-ef9b-4068-9e70-c5f25acd5578 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:25.228918 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a7aa5c5-ef9b-4068-9e70-c5f25acd5578 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:25.609330 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-2d63e47a-bc15-4330-94f3-cd5b968a85da tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 15:58:25.609861 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-2d63e47a-bc15-4330-94f3-cd5b968a85da tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 15:58:25.610213 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-2d63e47a-bc15-4330-94f3-cd5b968a85da tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 15:58:25.610618 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-2d63e47a-bc15-4330-94f3-cd5b968a85da tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 15:58:25.611207 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-2d63e47a-bc15-4330-94f3-cd5b968a85da tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 15:58:25.625343 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2d63e47a-bc15-4330-94f3-cd5b968a85da tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:25.626930 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2d63e47a-bc15-4330-94f3-cd5b968a85da tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:25.627392 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2d63e47a-bc15-4330-94f3-cd5b968a85da tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:25.628168 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2d63e47a-bc15-4330-94f3-cd5b968a85da tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:25.628631 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2d63e47a-bc15-4330-94f3-cd5b968a85da tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:25.629773 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2d63e47a-bc15-4330-94f3-cd5b968a85da tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:25.666233 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.quota [None req-2d63e47a-bc15-4330-94f3-cd5b968a85da tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Getting quotas for project a446dbd47db84c4987a3ee5332356b84. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 15:58:25.671895 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.quota [None req-2d63e47a-bc15-4330-94f3-cd5b968a85da tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Getting quotas for user 2fcfbaf5bab14a4783ca912a222341c0 and project a446dbd47db84c4987a3ee5332356b84. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 15:58:25.673405 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2a7aa5c5-ef9b-4068-9e70-c5f25acd5578 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ae4012f414796a9a82e177ce43af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0998ce41664645e6b2825dc435c8a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:25.675776 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:25.687244 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2d63e47a-bc15-4330-94f3-cd5b968a85da tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 15:58:25.689788 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2a7aa5c5-ef9b-4068-9e70-c5f25acd5578 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] 10.222.0.17 "GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8" status: 200 len: 1314 microversion: 2.1 time: 0.490669 Sep 07 15:58:25.690243 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2d63e47a-bc15-4330-94f3-cd5b968a85da tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cfe19284-9779-46f4-b458-81d5475ec82f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 15:58:25.692940 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 178/342] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:25 2022] GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8 => generated 1314 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:25.703270 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c740a205-f529-4bdd-9eab-009d7bf92394 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:25.704567 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c740a205-f529-4bdd-9eab-009d7bf92394 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: f39427e6-62a5-4a4e-96e8-644f03653722] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:25.714772 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c740a205-f529-4bdd-9eab-009d7bf92394 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:25.721688 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c740a205-f529-4bdd-9eab-009d7bf92394 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:25.722777 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c740a205-f529-4bdd-9eab-009d7bf92394 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:25.723980 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c740a205-f529-4bdd-9eab-009d7bf92394 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:25.725309 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c740a205-f529-4bdd-9eab-009d7bf92394 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:25.731338 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c740a205-f529-4bdd-9eab-009d7bf92394 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:25.785819 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2d63e47a-bc15-4330-94f3-cd5b968a85da tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.105333 Sep 07 15:58:25.789390 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 165/343] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Sep 7 15:58:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 1109 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 15:58:25.801458 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-02ebc14f-97ea-4914-9edd-ffb9514b8ee9 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:25.803382 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-02ebc14f-97ea-4914-9edd-ffb9514b8ee9 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] [instance: 3caa011a-a4bf-43bc-a309-ec34a2ebe9dc] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:25.813343 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-02ebc14f-97ea-4914-9edd-ffb9514b8ee9 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:25.814341 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-02ebc14f-97ea-4914-9edd-ffb9514b8ee9 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:25.815003 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-02ebc14f-97ea-4914-9edd-ffb9514b8ee9 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:25.828181 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-02ebc14f-97ea-4914-9edd-ffb9514b8ee9 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:25.829867 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-02ebc14f-97ea-4914-9edd-ffb9514b8ee9 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:25.831357 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-02ebc14f-97ea-4914-9edd-ffb9514b8ee9 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:26.053119 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c740a205-f529-4bdd-9eab-009d7bf92394 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:26.064568 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c740a205-f529-4bdd-9eab-009d7bf92394 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722" status: 200 len: 1501 microversion: 2.1 time: 0.370231 Sep 07 15:58:26.081299 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 179/344] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:25 2022] GET /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722 => generated 1501 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:26.091237 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e18ab682-b0c8-4043-bf3c-a6f3a8c7141d tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:26.092039 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e18ab682-b0c8-4043-bf3c-a6f3a8c7141d tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:26.188278 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e18ab682-b0c8-4043-bf3c-a6f3a8c7141d tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:26.196188 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e18ab682-b0c8-4043-bf3c-a6f3a8c7141d tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1238 microversion: 2.1 time: 0.112252 Sep 07 15:58:26.196735 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 180/345] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:26 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1238 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:26.213674 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b1c98e76-0163-4476-a3fb-fbc16aaab35f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8cdd2aa-a98b-406e-9664-b2fac8a6e1e7"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:58:26.223383 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b1c98e76-0163-4476-a3fb-fbc16aaab35f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: f39427e6-62a5-4a4e-96e8-644f03653722] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:26.233206 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-02ebc14f-97ea-4914-9edd-ffb9514b8ee9 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a393cb6b2343d697ec2e87d750c70a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf52e3718140d1b2e4883f8d5464f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:26.243318 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-02ebc14f-97ea-4914-9edd-ffb9514b8ee9 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] 10.222.0.17 "GET /compute/v2.1/servers/3caa011a-a4bf-43bc-a309-ec34a2ebe9dc" status: 200 len: 1314 microversion: 2.1 time: 0.450850 Sep 07 15:58:26.244851 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 166/346] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:25 2022] GET /compute/v2.1/servers/3caa011a-a4bf-43bc-a309-ec34a2ebe9dc => generated 1314 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:26.265970 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1c98e76-0163-4476-a3fb-fbc16aaab35f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:26.266762 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1c98e76-0163-4476-a3fb-fbc16aaab35f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:26.279298 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1c98e76-0163-4476-a3fb-fbc16aaab35f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:26.280780 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1c98e76-0163-4476-a3fb-fbc16aaab35f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:26.282111 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1c98e76-0163-4476-a3fb-fbc16aaab35f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:26.282839 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1c98e76-0163-4476-a3fb-fbc16aaab35f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:26.334872 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-b1c98e76-0163-4476-a3fb-fbc16aaab35f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] HTTP exception thrown: Cannot 'attach_volume' instance f39427e6-62a5-4a4e-96e8-644f03653722 while it is in vm_state rescued Sep 07 15:58:26.339116 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b1c98e76-0163-4476-a3fb-fbc16aaab35f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Request method failure captured: Sep 07 15:58:26.339116 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: request: POST /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722/os-volume_attachments HTTP/1.1 Sep 07 15:58:26.339116 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept: application/json Sep 07 15:58:26.339116 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Sep 07 15:58:26.339116 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Connection: close Sep 07 15:58:26.339116 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Length: 74 Sep 07 15:58:26.339116 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Type: application/json Sep 07 15:58:26.339116 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Host: 10.222.0.17 Sep 07 15:58:26.339116 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Sep 07 15:58:26.339116 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Sep 07 15:58:26.339116 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjGL8U3olZ2_NAu3h9ENgyu4mlOOEiN-5DzVT5ll2l4CQG1Al6-WZd8sJsfCXeHe8dqFbg7WeRmYV8ndjIQ3HiKhv70Sq_aPzDk3HT2nFi-G2crlFv8gLLPy9OLuVpMJdSfFhXkgQ7qyX93ubFTTXV_nBx0wb_NUMh1jc8VKXNTsHIdKw Sep 07 15:58:26.339116 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Sep 07 15:58:26.339116 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Sep 07 15:58:26.339116 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Sep 07 15:58:26.339116 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Sep 07 15:58:26.339116 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Sep 07 15:58:26.339116 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Sep 07 15:58:26.339116 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Id: 20596aac52254a159269aa634116f080 Sep 07 15:58:26.339116 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1951895607 Sep 07 15:58:26.339116 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Role: reader,member Sep 07 15:58:26.339116 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Roles: reader,member Sep 07 15:58:26.340525 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_20596aac52254a159269aa634116f080", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/20596aac52254a159269aa634116f080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/20596aac52254a159269aa634116f080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/20596aac52254a159269aa634116f080"}]}] Sep 07 15:58:26.340525 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1951895607 Sep 07 15:58:26.340525 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Id: 20596aac52254a159269aa634116f080 Sep 07 15:58:26.340525 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1951895607 Sep 07 15:58:26.340525 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User: tempest-ServerRescueNegativeTestJSON-1951895607-project Sep 07 15:58:26.340525 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Sep 07 15:58:26.340525 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Sep 07 15:58:26.340525 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Id: 7dc84ece6eb84315b54defd89be8a95c Sep 07 15:58:26.340525 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1951895607-project Sep 07 15:58:26.340525 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Sep 07 15:58:26.340525 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: {"volumeAttachment": {"volumeId": "f8cdd2aa-a98b-406e-9664-b2fac8a6e1e7"}} Sep 07 15:58:26.340525 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: method: > Sep 07 15:58:26.341311 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: exception: Cannot 'attach_volume' instance f39427e6-62a5-4a4e-96e8-644f03653722 while it is in vm_state rescued Sep 07 15:58:26.341311 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: action_args: {'server_id': 'f39427e6-62a5-4a4e-96e8-644f03653722', 'body': {'volumeAttachment': {'volumeId': 'f8cdd2aa-a98b-406e-9664-b2fac8a6e1e7'}}} Sep 07 15:58:26.341311 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 15:58:26.341311 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:58:26.341311 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 07 15:58:26.341311 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 07 15:58:26.341311 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 15:58:26.341311 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 15:58:26.341311 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 07 15:58:26.341311 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 07 15:58:26.341311 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f39427e6-62a5-4a4e-96e8-644f03653722 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 07 15:58:26.341311 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:58:26.341311 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 15:58:26.341311 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:58:26.341311 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:58:26.341311 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 15:58:26.341311 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 15:58:26.341311 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 15:58:26.341311 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 15:58:26.342536 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 15:58:26.342536 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 15:58:26.342536 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 15:58:26.342536 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 15:58:26.342536 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 15:58:26.342536 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 15:58:26.342536 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 15:58:26.342536 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 15:58:26.342536 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 07 15:58:26.342536 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 07 15:58:26.342536 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 07 15:58:26.342536 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 07 15:58:26.342536 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance f39427e6-62a5-4a4e-96e8-644f03653722 while it is in vm_state rescued Sep 07 15:58:26.342536 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:58:26.342536 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 15:58:26.342536 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:58:26.342536 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:58:26.342536 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 15:58:26.342536 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 15:58:26.344663 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 15:58:26.344663 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 15:58:26.344663 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance f39427e6-62a5-4a4e-96e8-644f03653722 while it is in vm_state rescued Sep 07 15:58:26.344663 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 15:58:26.344663 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b1c98e76-0163-4476-a3fb-fbc16aaab35f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Returning 409 to user: Cannot 'attach_volume' instance f39427e6-62a5-4a4e-96e8-644f03653722 while it is in vm_state rescued {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 15:58:26.344663 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b1c98e76-0163-4476-a3fb-fbc16aaab35f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "POST /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.143844 Sep 07 15:58:26.344663 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 181/347] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Sep 7 15:58:26 2022] POST /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722/os-volume_attachments => generated 152 bytes in 145 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 07 15:58:26.359805 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f478f21f-0e14-4698-8882-b171ba984b10 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:58:26.360836 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f478f21f-0e14-4698-8882-b171ba984b10 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: f39427e6-62a5-4a4e-96e8-644f03653722] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:26.369608 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f478f21f-0e14-4698-8882-b171ba984b10 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:26.370265 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f478f21f-0e14-4698-8882-b171ba984b10 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:26.370775 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f478f21f-0e14-4698-8882-b171ba984b10 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:26.371667 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f478f21f-0e14-4698-8882-b171ba984b10 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:26.380578 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f478f21f-0e14-4698-8882-b171ba984b10 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:26.385371 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f478f21f-0e14-4698-8882-b171ba984b10 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:26.517303 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f478f21f-0e14-4698-8882-b171ba984b10 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "POST /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722/action" status: 202 len: 0 microversion: 2.1 time: 0.165177 Sep 07 15:58:26.520421 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 167/348] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Sep 7 15:58:26 2022] POST /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 15:58:26.530603 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-db8f05da-cf1b-4efc-beca-5e3bc928e371 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:26.531413 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-db8f05da-cf1b-4efc-beca-5e3bc928e371 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: f39427e6-62a5-4a4e-96e8-644f03653722] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:26.540887 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db8f05da-cf1b-4efc-beca-5e3bc928e371 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:26.541465 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db8f05da-cf1b-4efc-beca-5e3bc928e371 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:26.542127 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db8f05da-cf1b-4efc-beca-5e3bc928e371 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:26.542927 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db8f05da-cf1b-4efc-beca-5e3bc928e371 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:26.543383 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db8f05da-cf1b-4efc-beca-5e3bc928e371 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:26.543889 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-db8f05da-cf1b-4efc-beca-5e3bc928e371 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:26.715061 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f22e0473-a023-4226-92d0-7c8785371022 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:26.716661 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f22e0473-a023-4226-92d0-7c8785371022 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] [instance: 22b4fa04-91a6-4b41-8a11-c545bca344a8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:26.731753 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f22e0473-a023-4226-92d0-7c8785371022 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:26.733310 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f22e0473-a023-4226-92d0-7c8785371022 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:26.737111 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f22e0473-a023-4226-92d0-7c8785371022 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:26.738230 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f22e0473-a023-4226-92d0-7c8785371022 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:26.738945 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f22e0473-a023-4226-92d0-7c8785371022 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:26.742554 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f22e0473-a023-4226-92d0-7c8785371022 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:26.862665 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-db8f05da-cf1b-4efc-beca-5e3bc928e371 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:26.870495 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-db8f05da-cf1b-4efc-beca-5e3bc928e371 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722" status: 200 len: 1509 microversion: 2.1 time: 0.345886 Sep 07 15:58:26.871055 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 182/349] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:26 2022] GET /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722 => generated 1509 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:26.960274 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-f22e0473-a023-4226-92d0-7c8785371022 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ae4012f414796a9a82e177ce43af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0998ce41664645e6b2825dc435c8a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:26.969936 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f22e0473-a023-4226-92d0-7c8785371022 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] 10.222.0.17 "GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8" status: 200 len: 1314 microversion: 2.1 time: 0.259373 Sep 07 15:58:26.970506 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 168/350] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:26 2022] GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:58:27.223585 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d51ddfaa-4972-4001-8c75-2f768255d5ad tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:27.224764 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d51ddfaa-4972-4001-8c75-2f768255d5ad tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:27.233779 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d51ddfaa-4972-4001-8c75-2f768255d5ad tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:27.234928 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d51ddfaa-4972-4001-8c75-2f768255d5ad tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:27.235884 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d51ddfaa-4972-4001-8c75-2f768255d5ad tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:27.236966 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d51ddfaa-4972-4001-8c75-2f768255d5ad tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:27.237656 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d51ddfaa-4972-4001-8c75-2f768255d5ad tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:27.238093 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d51ddfaa-4972-4001-8c75-2f768255d5ad tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:27.269549 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-67961216-8aad-48b6-8ff5-85c2d39e6aff tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:27.270403 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-67961216-8aad-48b6-8ff5-85c2d39e6aff tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] [instance: 3caa011a-a4bf-43bc-a309-ec34a2ebe9dc] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:27.285251 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-67961216-8aad-48b6-8ff5-85c2d39e6aff tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:27.285977 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-67961216-8aad-48b6-8ff5-85c2d39e6aff tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:27.286564 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-67961216-8aad-48b6-8ff5-85c2d39e6aff tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:27.287276 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-67961216-8aad-48b6-8ff5-85c2d39e6aff tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:27.287769 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-67961216-8aad-48b6-8ff5-85c2d39e6aff tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:27.288192 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-67961216-8aad-48b6-8ff5-85c2d39e6aff tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:27.349411 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d51ddfaa-4972-4001-8c75-2f768255d5ad tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:27.361037 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d51ddfaa-4972-4001-8c75-2f768255d5ad tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1242 microversion: 2.1 time: 0.141942 Sep 07 15:58:27.361624 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 183/351] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:27 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1242 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:27.505772 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-67961216-8aad-48b6-8ff5-85c2d39e6aff tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a393cb6b2343d697ec2e87d750c70a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf52e3718140d1b2e4883f8d5464f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:27.521110 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-67961216-8aad-48b6-8ff5-85c2d39e6aff tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] 10.222.0.17 "GET /compute/v2.1/servers/3caa011a-a4bf-43bc-a309-ec34a2ebe9dc" status: 200 len: 1314 microversion: 2.1 time: 0.254043 Sep 07 15:58:27.523041 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 169/352] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:27 2022] GET /compute/v2.1/servers/3caa011a-a4bf-43bc-a309-ec34a2ebe9dc => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:27.895975 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c4063176-d475-476f-84ed-34407995fbdd tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:27.897494 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c4063176-d475-476f-84ed-34407995fbdd tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: f39427e6-62a5-4a4e-96e8-644f03653722] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:27.899711 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:27.907702 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4063176-d475-476f-84ed-34407995fbdd tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:27.908197 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4063176-d475-476f-84ed-34407995fbdd tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:27.908629 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4063176-d475-476f-84ed-34407995fbdd tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:27.909325 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4063176-d475-476f-84ed-34407995fbdd tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:27.909774 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4063176-d475-476f-84ed-34407995fbdd tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:27.910215 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c4063176-d475-476f-84ed-34407995fbdd tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:27.916481 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:27.997217 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-741f5b32-daef-4ad6-b26c-a52c7f36ffe8 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:28.005413 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-741f5b32-daef-4ad6-b26c-a52c7f36ffe8 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] [instance: 22b4fa04-91a6-4b41-8a11-c545bca344a8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:28.017134 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-741f5b32-daef-4ad6-b26c-a52c7f36ffe8 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:28.018212 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-741f5b32-daef-4ad6-b26c-a52c7f36ffe8 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:28.020742 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-741f5b32-daef-4ad6-b26c-a52c7f36ffe8 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:28.022459 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-741f5b32-daef-4ad6-b26c-a52c7f36ffe8 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:28.025341 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-741f5b32-daef-4ad6-b26c-a52c7f36ffe8 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:28.026241 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-741f5b32-daef-4ad6-b26c-a52c7f36ffe8 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:28.287511 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-741f5b32-daef-4ad6-b26c-a52c7f36ffe8 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ae4012f414796a9a82e177ce43af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0998ce41664645e6b2825dc435c8a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:28.300482 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-741f5b32-daef-4ad6-b26c-a52c7f36ffe8 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] 10.222.0.17 "GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8" status: 200 len: 1314 microversion: 2.1 time: 0.309239 Sep 07 15:58:28.316095 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 170/353] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:27 2022] GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8 => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:28.387099 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-22da5ba3-9b6a-49f6-8d19-644687a6b1ab tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:28.387659 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-22da5ba3-9b6a-49f6-8d19-644687a6b1ab tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:28.394547 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-22da5ba3-9b6a-49f6-8d19-644687a6b1ab tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:28.395206 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-22da5ba3-9b6a-49f6-8d19-644687a6b1ab tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:28.395673 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-22da5ba3-9b6a-49f6-8d19-644687a6b1ab tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:28.396563 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-22da5ba3-9b6a-49f6-8d19-644687a6b1ab tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:28.397019 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-22da5ba3-9b6a-49f6-8d19-644687a6b1ab tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:28.397440 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-22da5ba3-9b6a-49f6-8d19-644687a6b1ab tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:28.446237 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c4063176-d475-476f-84ed-34407995fbdd tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:28.457212 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c4063176-d475-476f-84ed-34407995fbdd tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722" status: 200 len: 1509 microversion: 2.1 time: 0.566555 Sep 07 15:58:28.458086 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 184/354] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:27 2022] GET /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722 => generated 1509 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:28.472423 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-22da5ba3-9b6a-49f6-8d19-644687a6b1ab tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:28.480509 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-22da5ba3-9b6a-49f6-8d19-644687a6b1ab tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1290 microversion: 2.1 time: 0.098080 Sep 07 15:58:28.481396 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 171/355] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:28 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1290 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:58:28.547576 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-39bcdf4f-3b96-4b99-aeb9-35ca1b5710de tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:28.548364 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-39bcdf4f-3b96-4b99-aeb9-35ca1b5710de tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] [instance: 3caa011a-a4bf-43bc-a309-ec34a2ebe9dc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:28.554489 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-39bcdf4f-3b96-4b99-aeb9-35ca1b5710de tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:28.554969 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-39bcdf4f-3b96-4b99-aeb9-35ca1b5710de tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:28.555393 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-39bcdf4f-3b96-4b99-aeb9-35ca1b5710de tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:28.556135 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-39bcdf4f-3b96-4b99-aeb9-35ca1b5710de tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:28.556581 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-39bcdf4f-3b96-4b99-aeb9-35ca1b5710de tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:28.557001 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-39bcdf4f-3b96-4b99-aeb9-35ca1b5710de tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:28.813239 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-39bcdf4f-3b96-4b99-aeb9-35ca1b5710de tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a393cb6b2343d697ec2e87d750c70a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf52e3718140d1b2e4883f8d5464f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:28.827455 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-39bcdf4f-3b96-4b99-aeb9-35ca1b5710de tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] 10.222.0.17 "GET /compute/v2.1/servers/3caa011a-a4bf-43bc-a309-ec34a2ebe9dc" status: 200 len: 1314 microversion: 2.1 time: 0.283045 Sep 07 15:58:28.829748 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 185/356] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:28 2022] GET /compute/v2.1/servers/3caa011a-a4bf-43bc-a309-ec34a2ebe9dc => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:29.322704 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-18c8874c-848b-47ae-9440-3d6578533698 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:29.323941 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-18c8874c-848b-47ae-9440-3d6578533698 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] [instance: 22b4fa04-91a6-4b41-8a11-c545bca344a8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:29.336791 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-18c8874c-848b-47ae-9440-3d6578533698 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:29.337811 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-18c8874c-848b-47ae-9440-3d6578533698 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:29.348363 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-18c8874c-848b-47ae-9440-3d6578533698 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:29.349364 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-18c8874c-848b-47ae-9440-3d6578533698 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:29.350020 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-18c8874c-848b-47ae-9440-3d6578533698 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:29.350869 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-18c8874c-848b-47ae-9440-3d6578533698 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:29.481476 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ab7af678-ab44-4777-b468-edfe4ded20d7 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:29.483258 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ab7af678-ab44-4777-b468-edfe4ded20d7 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: f39427e6-62a5-4a4e-96e8-644f03653722] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:29.501121 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab7af678-ab44-4777-b468-edfe4ded20d7 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:29.501898 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab7af678-ab44-4777-b468-edfe4ded20d7 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:29.502519 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab7af678-ab44-4777-b468-edfe4ded20d7 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:29.503397 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab7af678-ab44-4777-b468-edfe4ded20d7 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:29.504024 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab7af678-ab44-4777-b468-edfe4ded20d7 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:29.504609 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ab7af678-ab44-4777-b468-edfe4ded20d7 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:29.514984 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-18c8874c-848b-47ae-9440-3d6578533698 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ae4012f414796a9a82e177ce43af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0998ce41664645e6b2825dc435c8a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:29.523875 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-18c8874c-848b-47ae-9440-3d6578533698 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] 10.222.0.17 "GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8" status: 200 len: 1314 microversion: 2.1 time: 0.204922 Sep 07 15:58:29.525051 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 172/357] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:29 2022] GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:29.530430 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-92e14ba7-b816-4bcc-aaaa-46041498ed47 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:29.531324 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-92e14ba7-b816-4bcc-aaaa-46041498ed47 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:29.538125 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-92e14ba7-b816-4bcc-aaaa-46041498ed47 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:29.538905 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-92e14ba7-b816-4bcc-aaaa-46041498ed47 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:29.539524 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-92e14ba7-b816-4bcc-aaaa-46041498ed47 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:29.540553 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-92e14ba7-b816-4bcc-aaaa-46041498ed47 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:29.541337 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-92e14ba7-b816-4bcc-aaaa-46041498ed47 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:29.541995 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-92e14ba7-b816-4bcc-aaaa-46041498ed47 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:29.611909 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-92e14ba7-b816-4bcc-aaaa-46041498ed47 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:29.619882 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-92e14ba7-b816-4bcc-aaaa-46041498ed47 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1298 microversion: 2.1 time: 0.093594 Sep 07 15:58:29.620440 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 173/358] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:29 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1298 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:29.776148 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ab7af678-ab44-4777-b468-edfe4ded20d7 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:29.784237 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ab7af678-ab44-4777-b468-edfe4ded20d7 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722" status: 200 len: 1509 microversion: 2.1 time: 0.306504 Sep 07 15:58:29.784832 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 186/359] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:29 2022] GET /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722 => generated 1509 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:58:29.855725 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-65934ac1-dadb-4074-961b-97ced238b66f tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:29.856330 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-65934ac1-dadb-4074-961b-97ced238b66f tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] [instance: 3caa011a-a4bf-43bc-a309-ec34a2ebe9dc] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:29.867840 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-65934ac1-dadb-4074-961b-97ced238b66f tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:29.868327 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-65934ac1-dadb-4074-961b-97ced238b66f tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:29.869360 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-65934ac1-dadb-4074-961b-97ced238b66f tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:29.870227 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-65934ac1-dadb-4074-961b-97ced238b66f tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:29.870832 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-65934ac1-dadb-4074-961b-97ced238b66f tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:29.871420 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-65934ac1-dadb-4074-961b-97ced238b66f tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:30.140590 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-65934ac1-dadb-4074-961b-97ced238b66f tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a393cb6b2343d697ec2e87d750c70a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf52e3718140d1b2e4883f8d5464f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:30.150036 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-65934ac1-dadb-4074-961b-97ced238b66f tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] 10.222.0.17 "GET /compute/v2.1/servers/3caa011a-a4bf-43bc-a309-ec34a2ebe9dc" status: 200 len: 1499 microversion: 2.1 time: 0.298063 Sep 07 15:58:30.150958 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 174/360] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:29 2022] GET /compute/v2.1/servers/3caa011a-a4bf-43bc-a309-ec34a2ebe9dc => generated 1499 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:30.552225 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-de85d691-0029-49b1-9b00-f379d36ed571 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:30.552848 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-de85d691-0029-49b1-9b00-f379d36ed571 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] [instance: 22b4fa04-91a6-4b41-8a11-c545bca344a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:30.559536 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de85d691-0029-49b1-9b00-f379d36ed571 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:30.560055 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de85d691-0029-49b1-9b00-f379d36ed571 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:30.561153 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de85d691-0029-49b1-9b00-f379d36ed571 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:30.562012 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de85d691-0029-49b1-9b00-f379d36ed571 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:30.562428 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de85d691-0029-49b1-9b00-f379d36ed571 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:30.562879 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de85d691-0029-49b1-9b00-f379d36ed571 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:30.642718 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5fe297b0-5f3d-475a-844b-2d6c03cb581f tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:30.643268 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5fe297b0-5f3d-475a-844b-2d6c03cb581f tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:30.651496 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5fe297b0-5f3d-475a-844b-2d6c03cb581f tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:30.660695 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5fe297b0-5f3d-475a-844b-2d6c03cb581f tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:30.661369 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5fe297b0-5f3d-475a-844b-2d6c03cb581f tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:30.662300 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5fe297b0-5f3d-475a-844b-2d6c03cb581f tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:30.662811 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5fe297b0-5f3d-475a-844b-2d6c03cb581f tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:30.663242 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5fe297b0-5f3d-475a-844b-2d6c03cb581f tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:30.714525 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-de85d691-0029-49b1-9b00-f379d36ed571 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ae4012f414796a9a82e177ce43af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0998ce41664645e6b2825dc435c8a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:30.722828 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-de85d691-0029-49b1-9b00-f379d36ed571 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] 10.222.0.17 "GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8" status: 200 len: 1314 microversion: 2.1 time: 0.175814 Sep 07 15:58:30.723744 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 187/361] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:30 2022] GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:30.784591 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-5fe297b0-5f3d-475a-844b-2d6c03cb581f tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:30.793712 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5fe297b0-5f3d-475a-844b-2d6c03cb581f tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1296 microversion: 2.1 time: 0.155349 Sep 07 15:58:30.800678 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 175/362] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:30 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1296 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:58:30.808203 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-26f1ec01-f835-48f8-bd87-8096319995e1 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:30.809086 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-26f1ec01-f835-48f8-bd87-8096319995e1 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: f39427e6-62a5-4a4e-96e8-644f03653722] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:30.816482 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26f1ec01-f835-48f8-bd87-8096319995e1 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:30.817163 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26f1ec01-f835-48f8-bd87-8096319995e1 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:30.817763 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26f1ec01-f835-48f8-bd87-8096319995e1 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:30.818766 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26f1ec01-f835-48f8-bd87-8096319995e1 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:30.819769 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26f1ec01-f835-48f8-bd87-8096319995e1 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:30.820533 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-26f1ec01-f835-48f8-bd87-8096319995e1 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:30.830080 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a04060f8-eb11-452a-abb6-30c0c67289f1 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:30.830655 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a04060f8-eb11-452a-abb6-30c0c67289f1 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] [instance: 3caa011a-a4bf-43bc-a309-ec34a2ebe9dc] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:30.837220 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a04060f8-eb11-452a-abb6-30c0c67289f1 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:30.838004 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a04060f8-eb11-452a-abb6-30c0c67289f1 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:30.838642 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a04060f8-eb11-452a-abb6-30c0c67289f1 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:30.839563 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a04060f8-eb11-452a-abb6-30c0c67289f1 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:30.840112 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a04060f8-eb11-452a-abb6-30c0c67289f1 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:30.840724 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a04060f8-eb11-452a-abb6-30c0c67289f1 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:30.867971 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a04060f8-eb11-452a-abb6-30c0c67289f1 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] [instance: 3caa011a-a4bf-43bc-a309-ec34a2ebe9dc] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 15:58:30.980089 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a04060f8-eb11-452a-abb6-30c0c67289f1 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3caa011a-a4bf-43bc-a309-ec34a2ebe9dc" status: 204 len: 0 microversion: 2.1 time: 0.145887 Sep 07 15:58:30.981338 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 176/363] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Sep 7 15:58:30 2022] DELETE /compute/v2.1/servers/3caa011a-a4bf-43bc-a309-ec34a2ebe9dc => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 15:58:30.993899 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-26f1ec01-f835-48f8-bd87-8096319995e1 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:30.994570 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-476b713d-df23-4df3-b336-a25c1fc04c89 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:30.995284 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-476b713d-df23-4df3-b336-a25c1fc04c89 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] [instance: 3caa011a-a4bf-43bc-a309-ec34a2ebe9dc] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:31.002406 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-476b713d-df23-4df3-b336-a25c1fc04c89 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:31.003129 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-26f1ec01-f835-48f8-bd87-8096319995e1 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722" status: 200 len: 1509 microversion: 2.1 time: 0.198586 Sep 07 15:58:31.003296 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-476b713d-df23-4df3-b336-a25c1fc04c89 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:31.003898 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-476b713d-df23-4df3-b336-a25c1fc04c89 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:31.004040 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 188/364] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:30 2022] GET /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722 => generated 1509 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:31.004889 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-476b713d-df23-4df3-b336-a25c1fc04c89 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:31.005344 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-476b713d-df23-4df3-b336-a25c1fc04c89 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:31.005767 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-476b713d-df23-4df3-b336-a25c1fc04c89 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:31.162442 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-476b713d-df23-4df3-b336-a25c1fc04c89 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a393cb6b2343d697ec2e87d750c70a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf52e3718140d1b2e4883f8d5464f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:31.171104 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-476b713d-df23-4df3-b336-a25c1fc04c89 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] 10.222.0.17 "GET /compute/v2.1/servers/3caa011a-a4bf-43bc-a309-ec34a2ebe9dc" status: 200 len: 1505 microversion: 2.1 time: 0.184243 Sep 07 15:58:31.171815 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 177/365] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:30 2022] GET /compute/v2.1/servers/3caa011a-a4bf-43bc-a309-ec34a2ebe9dc => generated 1505 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:31.640207 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-d2a0264d-1345-44f5-8c06-e735caffaa1f req-66eb7e25-dc47-43bb-9b67-03de8a674fea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22b4fa04-91a6-4b41-8a11-c545bca344a8", "name": "network-vif-plugged", "status": "completed", "tag": "ec56e8a9-c5e3-4861-bb4b-5279a8fb5849"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:58:31.654898 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d2a0264d-1345-44f5-8c06-e735caffaa1f req-66eb7e25-dc47-43bb-9b67-03de8a674fea service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:31.656047 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d2a0264d-1345-44f5-8c06-e735caffaa1f req-66eb7e25-dc47-43bb-9b67-03de8a674fea service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:31.656921 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d2a0264d-1345-44f5-8c06-e735caffaa1f req-66eb7e25-dc47-43bb-9b67-03de8a674fea service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:31.671348 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-d2a0264d-1345-44f5-8c06-e735caffaa1f req-66eb7e25-dc47-43bb-9b67-03de8a674fea service nova] Creating event network-vif-plugged:ec56e8a9-c5e3-4861-bb4b-5279a8fb5849 for instance 22b4fa04-91a6-4b41-8a11-c545bca344a8 on hv-cinder-85331 Sep 07 15:58:31.677185 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-d2a0264d-1345-44f5-8c06-e735caffaa1f req-66eb7e25-dc47-43bb-9b67-03de8a674fea service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044840 Sep 07 15:58:31.677927 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 189/366] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 15:58:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:58:31.746491 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a69d4807-2220-4e65-b0ce-8ec83a4fce3a tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:31.747724 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a69d4807-2220-4e65-b0ce-8ec83a4fce3a tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] [instance: 22b4fa04-91a6-4b41-8a11-c545bca344a8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:31.754813 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a69d4807-2220-4e65-b0ce-8ec83a4fce3a tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:31.755329 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a69d4807-2220-4e65-b0ce-8ec83a4fce3a tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:31.756019 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a69d4807-2220-4e65-b0ce-8ec83a4fce3a tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:31.756942 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a69d4807-2220-4e65-b0ce-8ec83a4fce3a tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:31.757407 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a69d4807-2220-4e65-b0ce-8ec83a4fce3a tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:31.757918 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a69d4807-2220-4e65-b0ce-8ec83a4fce3a tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:31.818781 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ace816e9-ae67-44e6-8064-772524bbef76 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:31.819515 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ace816e9-ae67-44e6-8064-772524bbef76 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:31.830641 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ace816e9-ae67-44e6-8064-772524bbef76 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:31.831151 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ace816e9-ae67-44e6-8064-772524bbef76 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:31.831628 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ace816e9-ae67-44e6-8064-772524bbef76 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:31.832341 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ace816e9-ae67-44e6-8064-772524bbef76 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:31.832823 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ace816e9-ae67-44e6-8064-772524bbef76 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:31.833250 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ace816e9-ae67-44e6-8064-772524bbef76 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:31.906912 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ace816e9-ae67-44e6-8064-772524bbef76 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:31.914766 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ace816e9-ae67-44e6-8064-772524bbef76 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1296 microversion: 2.1 time: 0.100796 Sep 07 15:58:31.915326 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 190/367] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:31 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1296 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:58:31.946375 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-a69d4807-2220-4e65-b0ce-8ec83a4fce3a tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ae4012f414796a9a82e177ce43af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0998ce41664645e6b2825dc435c8a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:31.954894 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:31.966609 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a69d4807-2220-4e65-b0ce-8ec83a4fce3a tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] 10.222.0.17 "GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8" status: 200 len: 1314 microversion: 2.1 time: 0.223038 Sep 07 15:58:31.966609 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 178/368] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:31 2022] GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:32.028387 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6bd76f62-2ef1-4682-add2-1f58edc05ffd tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:32.029007 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6bd76f62-2ef1-4682-add2-1f58edc05ffd tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: f39427e6-62a5-4a4e-96e8-644f03653722] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:32.035660 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6bd76f62-2ef1-4682-add2-1f58edc05ffd tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:32.036112 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6bd76f62-2ef1-4682-add2-1f58edc05ffd tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:32.036544 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6bd76f62-2ef1-4682-add2-1f58edc05ffd tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:32.037436 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6bd76f62-2ef1-4682-add2-1f58edc05ffd tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:32.038050 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6bd76f62-2ef1-4682-add2-1f58edc05ffd tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:32.038643 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6bd76f62-2ef1-4682-add2-1f58edc05ffd tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:32.183964 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6bd76f62-2ef1-4682-add2-1f58edc05ffd tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:32.193619 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6bd76f62-2ef1-4682-add2-1f58edc05ffd tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722" status: 200 len: 1509 microversion: 2.1 time: 0.171130 Sep 07 15:58:32.194177 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 191/369] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:32 2022] GET /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722 => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:32.194322 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f76d74b7-6bfb-45b4-bc78-f4a2075dd991 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:32.194992 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f76d74b7-6bfb-45b4-bc78-f4a2075dd991 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] [instance: 3caa011a-a4bf-43bc-a309-ec34a2ebe9dc] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:32.210005 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f76d74b7-6bfb-45b4-bc78-f4a2075dd991 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:32.210501 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f76d74b7-6bfb-45b4-bc78-f4a2075dd991 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:32.210936 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f76d74b7-6bfb-45b4-bc78-f4a2075dd991 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:32.211661 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f76d74b7-6bfb-45b4-bc78-f4a2075dd991 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:32.212114 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f76d74b7-6bfb-45b4-bc78-f4a2075dd991 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:32.212533 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f76d74b7-6bfb-45b4-bc78-f4a2075dd991 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:32.450096 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-f76d74b7-6bfb-45b4-bc78-f4a2075dd991 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a393cb6b2343d697ec2e87d750c70a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf52e3718140d1b2e4883f8d5464f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:32.460027 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f76d74b7-6bfb-45b4-bc78-f4a2075dd991 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] 10.222.0.17 "GET /compute/v2.1/servers/3caa011a-a4bf-43bc-a309-ec34a2ebe9dc" status: 200 len: 1505 microversion: 2.1 time: 0.269599 Sep 07 15:58:32.463907 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 179/370] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:32 2022] GET /compute/v2.1/servers/3caa011a-a4bf-43bc-a309-ec34a2ebe9dc => generated 1505 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:58:32.964798 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c940219d-8329-48ad-bbae-fab0b743cc99 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:32.965337 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c940219d-8329-48ad-bbae-fab0b743cc99 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:32.983281 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c940219d-8329-48ad-bbae-fab0b743cc99 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:32.984075 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c940219d-8329-48ad-bbae-fab0b743cc99 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:32.984651 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c940219d-8329-48ad-bbae-fab0b743cc99 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:32.985844 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c940219d-8329-48ad-bbae-fab0b743cc99 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:32.986526 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c940219d-8329-48ad-bbae-fab0b743cc99 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:32.987097 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c940219d-8329-48ad-bbae-fab0b743cc99 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:32.993362 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4204bd1b-4db6-4f6b-9f12-45101397b9c8 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:32.994666 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4204bd1b-4db6-4f6b-9f12-45101397b9c8 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] [instance: 22b4fa04-91a6-4b41-8a11-c545bca344a8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:33.009006 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4204bd1b-4db6-4f6b-9f12-45101397b9c8 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:33.009763 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4204bd1b-4db6-4f6b-9f12-45101397b9c8 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:33.011202 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4204bd1b-4db6-4f6b-9f12-45101397b9c8 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:33.013706 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4204bd1b-4db6-4f6b-9f12-45101397b9c8 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:33.014280 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4204bd1b-4db6-4f6b-9f12-45101397b9c8 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:33.015243 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4204bd1b-4db6-4f6b-9f12-45101397b9c8 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:33.114547 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c940219d-8329-48ad-bbae-fab0b743cc99 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:33.124211 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c940219d-8329-48ad-bbae-fab0b743cc99 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1296 microversion: 2.1 time: 0.186504 Sep 07 15:58:33.125460 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 192/371] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:32 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1296 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:33.219707 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f743aeb1-ed5a-4a49-a1f2-ca5756b8f17a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:33.223817 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f743aeb1-ed5a-4a49-a1f2-ca5756b8f17a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: f39427e6-62a5-4a4e-96e8-644f03653722] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:33.232809 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f743aeb1-ed5a-4a49-a1f2-ca5756b8f17a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:33.233500 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f743aeb1-ed5a-4a49-a1f2-ca5756b8f17a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:33.234108 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f743aeb1-ed5a-4a49-a1f2-ca5756b8f17a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:33.235471 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f743aeb1-ed5a-4a49-a1f2-ca5756b8f17a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:33.236151 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f743aeb1-ed5a-4a49-a1f2-ca5756b8f17a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:33.236776 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f743aeb1-ed5a-4a49-a1f2-ca5756b8f17a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:33.405977 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-4204bd1b-4db6-4f6b-9f12-45101397b9c8 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ae4012f414796a9a82e177ce43af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0998ce41664645e6b2825dc435c8a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:33.420116 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4204bd1b-4db6-4f6b-9f12-45101397b9c8 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] 10.222.0.17 "GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8" status: 200 len: 1314 microversion: 2.1 time: 0.429959 Sep 07 15:58:33.421247 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 180/372] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:32 2022] GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8 => generated 1314 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:33.492258 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-467afedc-4cf8-48f5-83fb-75491f1be00c tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:33.492868 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-467afedc-4cf8-48f5-83fb-75491f1be00c tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] [instance: 3caa011a-a4bf-43bc-a309-ec34a2ebe9dc] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:33.501943 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-467afedc-4cf8-48f5-83fb-75491f1be00c tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:33.502431 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-467afedc-4cf8-48f5-83fb-75491f1be00c tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:33.502870 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-467afedc-4cf8-48f5-83fb-75491f1be00c tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:33.503633 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-467afedc-4cf8-48f5-83fb-75491f1be00c tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:33.520637 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-467afedc-4cf8-48f5-83fb-75491f1be00c tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:33.521081 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-467afedc-4cf8-48f5-83fb-75491f1be00c tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:33.564059 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f743aeb1-ed5a-4a49-a1f2-ca5756b8f17a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:33.575338 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f743aeb1-ed5a-4a49-a1f2-ca5756b8f17a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722" status: 200 len: 1509 microversion: 2.1 time: 0.359345 Sep 07 15:58:33.576749 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 193/373] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:33 2022] GET /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722 => generated 1509 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:33.903926 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-467afedc-4cf8-48f5-83fb-75491f1be00c tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a393cb6b2343d697ec2e87d750c70a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf52e3718140d1b2e4883f8d5464f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:33.917047 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-467afedc-4cf8-48f5-83fb-75491f1be00c tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] 10.222.0.17 "GET /compute/v2.1/servers/3caa011a-a4bf-43bc-a309-ec34a2ebe9dc" status: 200 len: 1505 microversion: 2.1 time: 0.428081 Sep 07 15:58:33.918271 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 181/374] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:33 2022] GET /compute/v2.1/servers/3caa011a-a4bf-43bc-a309-ec34a2ebe9dc => generated 1505 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:58:34.148317 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4a795e82-d5c0-4c87-8bca-5a3f212f25f4 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:34.149617 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4a795e82-d5c0-4c87-8bca-5a3f212f25f4 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:34.156930 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a795e82-d5c0-4c87-8bca-5a3f212f25f4 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:34.167083 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a795e82-d5c0-4c87-8bca-5a3f212f25f4 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:34.169418 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a795e82-d5c0-4c87-8bca-5a3f212f25f4 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:34.170506 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a795e82-d5c0-4c87-8bca-5a3f212f25f4 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:34.172239 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a795e82-d5c0-4c87-8bca-5a3f212f25f4 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:34.176248 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a795e82-d5c0-4c87-8bca-5a3f212f25f4 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:34.444315 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-17be5431-78c3-4879-9301-694cfa6edd22 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:34.445548 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-17be5431-78c3-4879-9301-694cfa6edd22 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] [instance: 22b4fa04-91a6-4b41-8a11-c545bca344a8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:34.458557 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-17be5431-78c3-4879-9301-694cfa6edd22 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:34.459070 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-17be5431-78c3-4879-9301-694cfa6edd22 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:34.459514 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-17be5431-78c3-4879-9301-694cfa6edd22 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:34.463621 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-17be5431-78c3-4879-9301-694cfa6edd22 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:34.464146 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-17be5431-78c3-4879-9301-694cfa6edd22 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:34.464536 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-17be5431-78c3-4879-9301-694cfa6edd22 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:34.485165 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-4a795e82-d5c0-4c87-8bca-5a3f212f25f4 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:34.503882 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4a795e82-d5c0-4c87-8bca-5a3f212f25f4 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1364 microversion: 2.1 time: 0.359624 Sep 07 15:58:34.505788 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 194/375] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:34 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1364 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:34.603835 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-94caaf8c-3fe7-4425-8fd8-bb281326a134 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:34.605325 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-94caaf8c-3fe7-4425-8fd8-bb281326a134 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: f39427e6-62a5-4a4e-96e8-644f03653722] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:34.620033 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94caaf8c-3fe7-4425-8fd8-bb281326a134 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:34.620820 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94caaf8c-3fe7-4425-8fd8-bb281326a134 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:34.621482 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94caaf8c-3fe7-4425-8fd8-bb281326a134 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:34.625947 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94caaf8c-3fe7-4425-8fd8-bb281326a134 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:34.627287 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94caaf8c-3fe7-4425-8fd8-bb281326a134 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:34.628064 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94caaf8c-3fe7-4425-8fd8-bb281326a134 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:34.980536 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-94caaf8c-3fe7-4425-8fd8-bb281326a134 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:34.993769 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-94caaf8c-3fe7-4425-8fd8-bb281326a134 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722" status: 200 len: 1515 microversion: 2.1 time: 0.395297 Sep 07 15:58:34.995448 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 195/376] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:34 2022] GET /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722 => generated 1515 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:35.003706 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fa480d9c-5db6-4716-a082-354fd806f0c1 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:35.006481 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fa480d9c-5db6-4716-a082-354fd806f0c1 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] [instance: 3caa011a-a4bf-43bc-a309-ec34a2ebe9dc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:35.023237 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa480d9c-5db6-4716-a082-354fd806f0c1 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:35.023760 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa480d9c-5db6-4716-a082-354fd806f0c1 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:35.024203 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa480d9c-5db6-4716-a082-354fd806f0c1 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:35.024900 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa480d9c-5db6-4716-a082-354fd806f0c1 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:35.025348 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa480d9c-5db6-4716-a082-354fd806f0c1 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:35.025765 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fa480d9c-5db6-4716-a082-354fd806f0c1 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:35.319464 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-17be5431-78c3-4879-9301-694cfa6edd22 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ae4012f414796a9a82e177ce43af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0998ce41664645e6b2825dc435c8a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:35.332784 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-17be5431-78c3-4879-9301-694cfa6edd22 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] 10.222.0.17 "GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8" status: 200 len: 1314 microversion: 2.1 time: 0.892374 Sep 07 15:58:35.334057 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 182/377] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:34 2022] GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8 => generated 1314 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:35.378457 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-fa480d9c-5db6-4716-a082-354fd806f0c1 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a393cb6b2343d697ec2e87d750c70a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf52e3718140d1b2e4883f8d5464f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:35.420038 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fa480d9c-5db6-4716-a082-354fd806f0c1 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] 10.222.0.17 "GET /compute/v2.1/servers/3caa011a-a4bf-43bc-a309-ec34a2ebe9dc" status: 200 len: 1505 microversion: 2.1 time: 0.419619 Sep 07 15:58:35.421599 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 196/378] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:34 2022] GET /compute/v2.1/servers/3caa011a-a4bf-43bc-a309-ec34a2ebe9dc => generated 1505 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:35.531746 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-41098216-ef97-4bc6-8422-eb58b18d3fdf tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:35.532511 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-41098216-ef97-4bc6-8422-eb58b18d3fdf tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:35.543990 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-41098216-ef97-4bc6-8422-eb58b18d3fdf tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:35.545541 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-41098216-ef97-4bc6-8422-eb58b18d3fdf tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:35.548188 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-41098216-ef97-4bc6-8422-eb58b18d3fdf tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:35.552449 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-41098216-ef97-4bc6-8422-eb58b18d3fdf tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:35.553666 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-41098216-ef97-4bc6-8422-eb58b18d3fdf tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:35.554816 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-41098216-ef97-4bc6-8422-eb58b18d3fdf tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:35.617402 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-2c5df802-230f-4bc6-b741-55af0ba6dd5e req-31d65451-7309-4def-bc2e-ed6163a7ef7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9f7188c-7dad-469c-b915-511d7f6f7a14", "tag": "e8ba6d47-0763-4132-b207-05e0e03c1ad9"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:58:35.635919 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2c5df802-230f-4bc6-b741-55af0ba6dd5e req-31d65451-7309-4def-bc2e-ed6163a7ef7a service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:35.637235 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2c5df802-230f-4bc6-b741-55af0ba6dd5e req-31d65451-7309-4def-bc2e-ed6163a7ef7a service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:35.639414 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-2c5df802-230f-4bc6-b741-55af0ba6dd5e req-31d65451-7309-4def-bc2e-ed6163a7ef7a service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:35.656603 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:35.669836 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-2c5df802-230f-4bc6-b741-55af0ba6dd5e req-31d65451-7309-4def-bc2e-ed6163a7ef7a service nova] Creating event network-changed:e8ba6d47-0763-4132-b207-05e0e03c1ad9 for instance d9f7188c-7dad-469c-b915-511d7f6f7a14 on hv-cinder-85331 Sep 07 15:58:35.675595 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-2c5df802-230f-4bc6-b741-55af0ba6dd5e req-31d65451-7309-4def-bc2e-ed6163a7ef7a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063282 Sep 07 15:58:35.676735 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 197/379] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 15:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:58:35.681245 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:35.937819 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-41098216-ef97-4bc6-8422-eb58b18d3fdf tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:35.947276 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-41098216-ef97-4bc6-8422-eb58b18d3fdf tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1364 microversion: 2.1 time: 0.420794 Sep 07 15:58:35.948119 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 183/380] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:35 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1364 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:36.312707 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-4b95d782-cf0b-4bbf-8f55-ae4c187c8701 req-8706a331-c9de-48b4-bbef-1ad9ed816665 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3caa011a-a4bf-43bc-a309-ec34a2ebe9dc", "name": "network-vif-deleted", "tag": "090e856b-d04b-4dd3-9916-324029e8faf2"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:58:36.321409 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=6 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:36.326592 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-4b95d782-cf0b-4bbf-8f55-ae4c187c8701 req-8706a331-c9de-48b4-bbef-1ad9ed816665 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:36.327329 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-4b95d782-cf0b-4bbf-8f55-ae4c187c8701 req-8706a331-c9de-48b4-bbef-1ad9ed816665 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:36.328072 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-4b95d782-cf0b-4bbf-8f55-ae4c187c8701 req-8706a331-c9de-48b4-bbef-1ad9ed816665 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:36.340611 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-4b95d782-cf0b-4bbf-8f55-ae4c187c8701 req-8706a331-c9de-48b4-bbef-1ad9ed816665 service nova] Creating event network-vif-deleted:090e856b-d04b-4dd3-9916-324029e8faf2 for instance 3caa011a-a4bf-43bc-a309-ec34a2ebe9dc on hv-cinder-85331 Sep 07 15:58:36.347222 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-4b95d782-cf0b-4bbf-8f55-ae4c187c8701 req-8706a331-c9de-48b4-bbef-1ad9ed816665 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039112 Sep 07 15:58:36.348257 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 198/381] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 15:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:58:36.356894 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-97ab3041-fb99-424f-be8a-9a495b563f21 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:36.357540 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-97ab3041-fb99-424f-be8a-9a495b563f21 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] [instance: 22b4fa04-91a6-4b41-8a11-c545bca344a8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:36.365746 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-97ab3041-fb99-424f-be8a-9a495b563f21 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:36.366217 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-97ab3041-fb99-424f-be8a-9a495b563f21 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:36.366656 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-97ab3041-fb99-424f-be8a-9a495b563f21 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:36.368333 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-97ab3041-fb99-424f-be8a-9a495b563f21 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:36.368987 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-97ab3041-fb99-424f-be8a-9a495b563f21 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:36.369640 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-97ab3041-fb99-424f-be8a-9a495b563f21 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:36.443441 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1fd81d52-85d6-4b54-b684-2f2115b2e405 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:36.444307 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1fd81d52-85d6-4b54-b684-2f2115b2e405 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] [instance: 3caa011a-a4bf-43bc-a309-ec34a2ebe9dc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:36.452627 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fd81d52-85d6-4b54-b684-2f2115b2e405 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:36.453614 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fd81d52-85d6-4b54-b684-2f2115b2e405 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:36.454860 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fd81d52-85d6-4b54-b684-2f2115b2e405 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:36.456799 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fd81d52-85d6-4b54-b684-2f2115b2e405 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:36.457506 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fd81d52-85d6-4b54-b684-2f2115b2e405 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:36.458302 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1fd81d52-85d6-4b54-b684-2f2115b2e405 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:36.629374 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1fd81d52-85d6-4b54-b684-2f2115b2e405 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a393cb6b2343d697ec2e87d750c70a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf52e3718140d1b2e4883f8d5464f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:36.643580 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1fd81d52-85d6-4b54-b684-2f2115b2e405 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] 10.222.0.17 "GET /compute/v2.1/servers/3caa011a-a4bf-43bc-a309-ec34a2ebe9dc" status: 200 len: 1299 microversion: 2.1 time: 0.204386 Sep 07 15:58:36.644674 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 199/382] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:36 2022] GET /compute/v2.1/servers/3caa011a-a4bf-43bc-a309-ec34a2ebe9dc => generated 1299 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:58:36.652452 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5227dd2c-9134-43a2-b431-ae1b2016f9ea tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Action: 'create', calling method: .version_select at 0x7ff9a5d0cc10>, body: {"keypair": {"name": "tempest-keypair-381695792", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZ+enL5h/vbClSgNH+Jpc9wIvj2J913xjF6Zcesv8D4JlErR0oj82Mfn3kdomlD1+HPwDfGGFfjSGCb8fKWbUWL4ZbCG6QiNabc6c1l33NLoOLzzAXIIhIJ6Amq7LJHNw=="}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:58:36.659589 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-97ab3041-fb99-424f-be8a-9a495b563f21 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ae4012f414796a9a82e177ce43af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0998ce41664645e6b2825dc435c8a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:36.674715 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-97ab3041-fb99-424f-be8a-9a495b563f21 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] 10.222.0.17 "GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8" status: 200 len: 1314 microversion: 2.1 time: 0.321474 Sep 07 15:58:36.676411 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 184/383] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:36 2022] GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8 => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:36.699248 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-5227dd2c-9134-43a2-b431-ae1b2016f9ea tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Getting quotas for project 20596aac52254a159269aa634116f080. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 15:58:36.707212 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-5227dd2c-9134-43a2-b431-ae1b2016f9ea tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Getting quotas for user 7dc84ece6eb84315b54defd89be8a95c and project 20596aac52254a159269aa634116f080. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 15:58:36.739123 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5227dd2c-9134-43a2-b431-ae1b2016f9ea tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.092617 Sep 07 15:58:36.740041 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 200/384] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Sep 7 15:58:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:58:36.971235 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e48852c3-ea66-44db-befb-4c3d13f5f2e9 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:36.972248 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e48852c3-ea66-44db-befb-4c3d13f5f2e9 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:36.979036 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e48852c3-ea66-44db-befb-4c3d13f5f2e9 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:36.979523 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e48852c3-ea66-44db-befb-4c3d13f5f2e9 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:36.979985 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e48852c3-ea66-44db-befb-4c3d13f5f2e9 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:36.980681 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e48852c3-ea66-44db-befb-4c3d13f5f2e9 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:36.981135 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e48852c3-ea66-44db-befb-4c3d13f5f2e9 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:36.981552 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e48852c3-ea66-44db-befb-4c3d13f5f2e9 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:37.308745 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-e48852c3-ea66-44db-befb-4c3d13f5f2e9 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:37.321486 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e48852c3-ea66-44db-befb-4c3d13f5f2e9 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1364 microversion: 2.1 time: 0.354533 Sep 07 15:58:37.322527 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 185/385] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:36 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1364 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:37.668927 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d5885c5a-c899-4286-bb6e-6c2ed4233843 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:37.671039 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d5885c5a-c899-4286-bb6e-6c2ed4233843 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] [instance: 3caa011a-a4bf-43bc-a309-ec34a2ebe9dc] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:37.690283 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5885c5a-c899-4286-bb6e-6c2ed4233843 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:37.691055 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5885c5a-c899-4286-bb6e-6c2ed4233843 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:37.693212 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5885c5a-c899-4286-bb6e-6c2ed4233843 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:37.693975 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5885c5a-c899-4286-bb6e-6c2ed4233843 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:37.694438 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5885c5a-c899-4286-bb6e-6c2ed4233843 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:37.698001 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5885c5a-c899-4286-bb6e-6c2ed4233843 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:37.698550 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-efa7f092-8d0d-4284-8f66-513bc8fdfd87 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:37.699883 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-efa7f092-8d0d-4284-8f66-513bc8fdfd87 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] [instance: 22b4fa04-91a6-4b41-8a11-c545bca344a8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:37.706876 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-efa7f092-8d0d-4284-8f66-513bc8fdfd87 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:37.707745 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-efa7f092-8d0d-4284-8f66-513bc8fdfd87 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:37.708518 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-efa7f092-8d0d-4284-8f66-513bc8fdfd87 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:37.709659 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-efa7f092-8d0d-4284-8f66-513bc8fdfd87 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:37.712586 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-efa7f092-8d0d-4284-8f66-513bc8fdfd87 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:37.713322 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-efa7f092-8d0d-4284-8f66-513bc8fdfd87 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:37.771345 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5885c5a-c899-4286-bb6e-6c2ed4233843 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:37.777694 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5885c5a-c899-4286-bb6e-6c2ed4233843 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:37.778385 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d5885c5a-c899-4286-bb6e-6c2ed4233843 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:37.779053 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-d5885c5a-c899-4286-bb6e-6c2ed4233843 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lazy-loading 'fault' on Instance uuid 3caa011a-a4bf-43bc-a309-ec34a2ebe9dc {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 15:58:37.921358 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d5885c5a-c899-4286-bb6e-6c2ed4233843 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a393cb6b2343d697ec2e87d750c70a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf52e3718140d1b2e4883f8d5464f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:37.931560 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d5885c5a-c899-4286-bb6e-6c2ed4233843 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] 10.222.0.17 "GET /compute/v2.1/servers/3caa011a-a4bf-43bc-a309-ec34a2ebe9dc" status: 200 len: 1304 microversion: 2.1 time: 0.268999 Sep 07 15:58:37.932174 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 201/386] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:37 2022] GET /compute/v2.1/servers/3caa011a-a4bf-43bc-a309-ec34a2ebe9dc => generated 1304 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:38.346816 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0606d611-e5dd-4f29-91fa-e0620a56f607 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:38.347421 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0606d611-e5dd-4f29-91fa-e0620a56f607 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:38.353758 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0606d611-e5dd-4f29-91fa-e0620a56f607 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:38.354238 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0606d611-e5dd-4f29-91fa-e0620a56f607 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:38.354665 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0606d611-e5dd-4f29-91fa-e0620a56f607 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:38.355340 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0606d611-e5dd-4f29-91fa-e0620a56f607 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:38.355811 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0606d611-e5dd-4f29-91fa-e0620a56f607 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:38.356227 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0606d611-e5dd-4f29-91fa-e0620a56f607 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:38.380214 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-efa7f092-8d0d-4284-8f66-513bc8fdfd87 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ae4012f414796a9a82e177ce43af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0998ce41664645e6b2825dc435c8a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:38.388860 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-efa7f092-8d0d-4284-8f66-513bc8fdfd87 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] 10.222.0.17 "GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8" status: 200 len: 1462 microversion: 2.1 time: 0.694076 Sep 07 15:58:38.389719 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 186/387] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:37 2022] GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8 => generated 1462 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:58:38.440524 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-78af5ba0-44ae-4828-9919-217849acab8a tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:38.441248 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-78af5ba0-44ae-4828-9919-217849acab8a tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] [instance: 22b4fa04-91a6-4b41-8a11-c545bca344a8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:38.447382 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78af5ba0-44ae-4828-9919-217849acab8a tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:38.447953 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78af5ba0-44ae-4828-9919-217849acab8a tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:38.448571 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78af5ba0-44ae-4828-9919-217849acab8a tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:38.449256 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78af5ba0-44ae-4828-9919-217849acab8a tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:38.449714 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78af5ba0-44ae-4828-9919-217849acab8a tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:38.450306 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78af5ba0-44ae-4828-9919-217849acab8a tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:38.481183 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-78af5ba0-44ae-4828-9919-217849acab8a tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] [instance: 22b4fa04-91a6-4b41-8a11-c545bca344a8] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 15:58:38.518946 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-0606d611-e5dd-4f29-91fa-e0620a56f607 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:38.531335 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0606d611-e5dd-4f29-91fa-e0620a56f607 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1364 microversion: 2.1 time: 0.188286 Sep 07 15:58:38.536259 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 202/388] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:38 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1364 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:58:38.608115 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-78af5ba0-44ae-4828-9919-217849acab8a tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] 10.222.0.17 "DELETE /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8" status: 204 len: 0 microversion: 2.1 time: 0.171439 Sep 07 15:58:38.608937 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 187/389] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Sep 7 15:58:38 2022] DELETE /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 15:58:38.622633 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-be8fca47-9a1b-4262-b6a4-2070dcf26655 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:38.624177 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-be8fca47-9a1b-4262-b6a4-2070dcf26655 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] [instance: 22b4fa04-91a6-4b41-8a11-c545bca344a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:38.636476 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be8fca47-9a1b-4262-b6a4-2070dcf26655 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:38.637377 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be8fca47-9a1b-4262-b6a4-2070dcf26655 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:38.638460 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be8fca47-9a1b-4262-b6a4-2070dcf26655 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:38.640367 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be8fca47-9a1b-4262-b6a4-2070dcf26655 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:38.640834 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be8fca47-9a1b-4262-b6a4-2070dcf26655 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:38.641469 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-be8fca47-9a1b-4262-b6a4-2070dcf26655 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:38.661489 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:38.809582 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-be8fca47-9a1b-4262-b6a4-2070dcf26655 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ae4012f414796a9a82e177ce43af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0998ce41664645e6b2825dc435c8a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:38.819442 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-be8fca47-9a1b-4262-b6a4-2070dcf26655 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] 10.222.0.17 "GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8" status: 200 len: 1468 microversion: 2.1 time: 0.206014 Sep 07 15:58:38.820024 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 203/390] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:38 2022] GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8 => generated 1468 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:38.958790 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f4464a1f-d4f0-4fff-be67-53af68cef185 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:38.959494 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f4464a1f-d4f0-4fff-be67-53af68cef185 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] [instance: 3caa011a-a4bf-43bc-a309-ec34a2ebe9dc] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:38.967477 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f4464a1f-d4f0-4fff-be67-53af68cef185 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:38.967960 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f4464a1f-d4f0-4fff-be67-53af68cef185 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:38.968387 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f4464a1f-d4f0-4fff-be67-53af68cef185 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:38.969080 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f4464a1f-d4f0-4fff-be67-53af68cef185 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:38.969528 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f4464a1f-d4f0-4fff-be67-53af68cef185 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:38.970031 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f4464a1f-d4f0-4fff-be67-53af68cef185 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:38.989430 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-f4464a1f-d4f0-4fff-be67-53af68cef185 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] HTTP exception thrown: Instance 3caa011a-a4bf-43bc-a309-ec34a2ebe9dc could not be found. Sep 07 15:58:38.991081 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f4464a1f-d4f0-4fff-be67-53af68cef185 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Request method failure captured: Sep 07 15:58:38.991081 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/3caa011a-a4bf-43bc-a309-ec34a2ebe9dc HTTP/1.1 Sep 07 15:58:38.991081 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Accept: application/json Sep 07 15:58:38.991081 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Accept-Encoding: identity Sep 07 15:58:38.991081 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Connection: close Sep 07 15:58:38.991081 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Content-Length: 0 Sep 07 15:58:38.991081 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Content-Type: application/json Sep 07 15:58:38.991081 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Host: 10.222.0.17 Sep 07 15:58:38.991081 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Openstack-System-Scope: None Sep 07 15:58:38.991081 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Sep 07 15:58:38.991081 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjGL9mXiE7hbYOlKchVchMyPeJFidODTaSOJj-YwR-A7JC596J3xCzx5ZqusPkGbl59wR2-wMAq9QQBlyucV1Bk29rqSyJ417r9nKpkgFpOrZVagK_WC3CbGTsUEEplybBGzUeDJdJg_dZRcSIdXEqtsxpqaw-61EbD9X-ViiQBXUFYQM Sep 07 15:58:38.991081 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Domain-Id: None Sep 07 15:58:38.991081 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Domain-Name: None Sep 07 15:58:38.991081 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Identity-Status: Confirmed Sep 07 15:58:38.991081 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Is-Admin-Project: True Sep 07 15:58:38.991081 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Domain-Id: default Sep 07 15:58:38.991081 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Domain-Name: Default Sep 07 15:58:38.991081 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Id: 4ebf52e3718140d1b2e4883f8d5464f4 Sep 07 15:58:38.991081 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Name: tempest-VolumesActionsTest-318390915 Sep 07 15:58:38.991081 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Role: reader,member Sep 07 15:58:38.991081 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Roles: reader,member Sep 07 15:58:38.992470 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4ebf52e3718140d1b2e4883f8d5464f4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4ebf52e3718140d1b2e4883f8d5464f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4ebf52e3718140d1b2e4883f8d5464f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4ebf52e3718140d1b2e4883f8d5464f4"}]}] Sep 07 15:58:38.992470 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant: tempest-VolumesActionsTest-318390915 Sep 07 15:58:38.992470 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant-Id: 4ebf52e3718140d1b2e4883f8d5464f4 Sep 07 15:58:38.992470 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant-Name: tempest-VolumesActionsTest-318390915 Sep 07 15:58:38.992470 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User: tempest-VolumesActionsTest-318390915-project Sep 07 15:58:38.992470 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Domain-Id: default Sep 07 15:58:38.992470 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Domain-Name: Default Sep 07 15:58:38.992470 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Id: 72a393cb6b2343d697ec2e87d750c70a Sep 07 15:58:38.992470 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Name: tempest-VolumesActionsTest-318390915-project Sep 07 15:58:38.992470 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: method: > Sep 07 15:58:38.992470 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: exception: Instance 3caa011a-a4bf-43bc-a309-ec34a2ebe9dc could not be found. Sep 07 15:58:38.992470 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: action_args: {'id': '3caa011a-a4bf-43bc-a309-ec34a2ebe9dc'} Sep 07 15:58:38.993224 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 15:58:38.993224 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:58:38.993224 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 15:58:38.993224 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 15:58:38.993224 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 15:58:38.993224 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 15:58:38.993224 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 15:58:38.993224 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 15:58:38.993224 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 15:58:38.993224 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 15:58:38.993224 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3caa011a-a4bf-43bc-a309-ec34a2ebe9dc could not be found. Sep 07 15:58:38.993224 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 15:58:38.993224 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 15:58:38.993224 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 15:58:38.993224 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:58:38.993224 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 15:58:38.993224 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 15:58:38.993224 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 15:58:38.993224 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 15:58:38.993224 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 15:58:38.994525 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 15:58:38.994525 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 15:58:38.994525 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 15:58:38.994525 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 15:58:38.994525 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 15:58:38.994525 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 15:58:38.994525 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 15:58:38.994525 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3caa011a-a4bf-43bc-a309-ec34a2ebe9dc could not be found. Sep 07 15:58:38.994525 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 15:58:38.994525 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 15:58:38.994525 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 15:58:38.994525 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:58:38.994525 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 15:58:38.994525 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 15:58:38.994525 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 15:58:38.994525 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 15:58:38.994525 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3caa011a-a4bf-43bc-a309-ec34a2ebe9dc could not be found. Sep 07 15:58:38.994525 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 15:58:38.995674 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f4464a1f-d4f0-4fff-be67-53af68cef185 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] Returning 404 to user: Instance 3caa011a-a4bf-43bc-a309-ec34a2ebe9dc could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 15:58:38.995674 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f4464a1f-d4f0-4fff-be67-53af68cef185 tempest-VolumesActionsTest-318390915 tempest-VolumesActionsTest-318390915-project] 10.222.0.17 "GET /compute/v2.1/servers/3caa011a-a4bf-43bc-a309-ec34a2ebe9dc" status: 404 len: 111 microversion: 2.1 time: 0.037919 Sep 07 15:58:38.995674 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 188/391] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:38 2022] GET /compute/v2.1/servers/3caa011a-a4bf-43bc-a309-ec34a2ebe9dc => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 15:58:39.359690 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-72553632-7625-45d0-8b96-21a22fe1a373 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-741001002", "imageRef": "cfe19284-9779-46f4-b458-81d5475ec82f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "230587ed-e651-463c-bff3-6daa9b0897e1"}], "security_groups": [{"name": "tempest-securitygroup--1096530251"}], "key_name": "tempest-keypair-381695792", "user_data": "}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:58:39.536283 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-72553632-7625-45d0-8b96-21a22fe1a373 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] validate_networks() for [('230587ed-e651-463c-bff3-6daa9b0897e1', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 15:58:39.561882 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1616fbf1-7d4f-4a89-a914-e2cc600f620a tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:39.562638 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1616fbf1-7d4f-4a89-a914-e2cc600f620a tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:39.573203 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1616fbf1-7d4f-4a89-a914-e2cc600f620a tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:39.573954 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1616fbf1-7d4f-4a89-a914-e2cc600f620a tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:39.574657 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1616fbf1-7d4f-4a89-a914-e2cc600f620a tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:39.576585 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1616fbf1-7d4f-4a89-a914-e2cc600f620a tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:39.578150 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1616fbf1-7d4f-4a89-a914-e2cc600f620a tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:39.578858 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1616fbf1-7d4f-4a89-a914-e2cc600f620a tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:39.911034 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-1616fbf1-7d4f-4a89-a914-e2cc600f620a tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:39.924940 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1616fbf1-7d4f-4a89-a914-e2cc600f620a tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1364 microversion: 2.1 time: 0.369115 Sep 07 15:58:39.948167 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 189/392] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:39 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1364 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:39.961956 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-be477a5a-c5b9-4a30-b35e-c085f073f598 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:39.962917 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-be477a5a-c5b9-4a30-b35e-c085f073f598 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] [instance: 22b4fa04-91a6-4b41-8a11-c545bca344a8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:39.974872 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-be477a5a-c5b9-4a30-b35e-c085f073f598 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:39.975366 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-be477a5a-c5b9-4a30-b35e-c085f073f598 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:39.976084 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-be477a5a-c5b9-4a30-b35e-c085f073f598 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:39.976783 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-be477a5a-c5b9-4a30-b35e-c085f073f598 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:39.977220 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-be477a5a-c5b9-4a30-b35e-c085f073f598 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:39.977640 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-be477a5a-c5b9-4a30-b35e-c085f073f598 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:40.242520 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-be477a5a-c5b9-4a30-b35e-c085f073f598 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ae4012f414796a9a82e177ce43af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0998ce41664645e6b2825dc435c8a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:40.261448 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-be477a5a-c5b9-4a30-b35e-c085f073f598 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] 10.222.0.17 "GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8" status: 200 len: 1468 microversion: 2.1 time: 0.311385 Sep 07 15:58:40.262725 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 190/393] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:39 2022] GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8 => generated 1468 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:40.688934 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-72553632-7625-45d0-8b96-21a22fe1a373 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 15:58:40.689587 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-72553632-7625-45d0-8b96-21a22fe1a373 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 15:58:40.690095 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-72553632-7625-45d0-8b96-21a22fe1a373 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 15:58:40.690511 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-72553632-7625-45d0-8b96-21a22fe1a373 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 15:58:40.690926 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-72553632-7625-45d0-8b96-21a22fe1a373 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 15:58:40.700586 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-72553632-7625-45d0-8b96-21a22fe1a373 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:40.701820 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-72553632-7625-45d0-8b96-21a22fe1a373 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:40.702513 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-72553632-7625-45d0-8b96-21a22fe1a373 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:40.703481 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-72553632-7625-45d0-8b96-21a22fe1a373 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:40.704213 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-72553632-7625-45d0-8b96-21a22fe1a373 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:40.704865 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-72553632-7625-45d0-8b96-21a22fe1a373 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:40.724184 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-72553632-7625-45d0-8b96-21a22fe1a373 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Getting quotas for project 20596aac52254a159269aa634116f080. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 15:58:40.729323 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-72553632-7625-45d0-8b96-21a22fe1a373 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Getting quotas for user 7dc84ece6eb84315b54defd89be8a95c and project 20596aac52254a159269aa634116f080. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 15:58:40.740934 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-72553632-7625-45d0-8b96-21a22fe1a373 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 15:58:40.743326 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-72553632-7625-45d0-8b96-21a22fe1a373 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cfe19284-9779-46f4-b458-81d5475ec82f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 15:58:40.793855 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-72553632-7625-45d0-8b96-21a22fe1a373 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.438929 Sep 07 15:58:40.795252 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 204/394] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Sep 7 15:58:39 2022] POST /compute/v2.1/servers => generated 409 bytes in 1441 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 15:58:40.806616 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f009a84b-2fd3-44fa-ab2e-47d1bb0c3f7c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:40.807423 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f009a84b-2fd3-44fa-ab2e-47d1bb0c3f7c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:40.927193 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-f009a84b-2fd3-44fa-ab2e-47d1bb0c3f7c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:40.935038 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f009a84b-2fd3-44fa-ab2e-47d1bb0c3f7c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed" status: 200 len: 1244 microversion: 2.1 time: 0.132651 Sep 07 15:58:40.938106 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 191/395] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:40 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed => generated 1244 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:40.958233 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-806793cb-bd5c-4290-a68d-fdd248278c2a tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:40.958873 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-806793cb-bd5c-4290-a68d-fdd248278c2a tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:40.974723 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-806793cb-bd5c-4290-a68d-fdd248278c2a tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:40.975141 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-806793cb-bd5c-4290-a68d-fdd248278c2a tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:40.976009 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-806793cb-bd5c-4290-a68d-fdd248278c2a tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:40.978027 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-806793cb-bd5c-4290-a68d-fdd248278c2a tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:40.984894 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-806793cb-bd5c-4290-a68d-fdd248278c2a tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:40.986543 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-806793cb-bd5c-4290-a68d-fdd248278c2a tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:41.186977 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-806793cb-bd5c-4290-a68d-fdd248278c2a tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:41.267750 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-806793cb-bd5c-4290-a68d-fdd248278c2a tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1364 microversion: 2.1 time: 0.314393 Sep 07 15:58:41.268806 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 205/396] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:40 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1364 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:41.293839 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-acc2d191-fb90-4876-9502-efc6358f3415 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:41.296837 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-acc2d191-fb90-4876-9502-efc6358f3415 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] [instance: 22b4fa04-91a6-4b41-8a11-c545bca344a8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:41.314036 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-acc2d191-fb90-4876-9502-efc6358f3415 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:41.314898 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-acc2d191-fb90-4876-9502-efc6358f3415 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:41.315625 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-acc2d191-fb90-4876-9502-efc6358f3415 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:41.316613 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-acc2d191-fb90-4876-9502-efc6358f3415 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:41.317423 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-acc2d191-fb90-4876-9502-efc6358f3415 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:41.318607 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-acc2d191-fb90-4876-9502-efc6358f3415 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:41.561824 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-acc2d191-fb90-4876-9502-efc6358f3415 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ae4012f414796a9a82e177ce43af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0998ce41664645e6b2825dc435c8a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:41.572038 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-acc2d191-fb90-4876-9502-efc6358f3415 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] 10.222.0.17 "GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8" status: 200 len: 1468 microversion: 2.1 time: 0.287425 Sep 07 15:58:41.574984 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 192/397] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:41 2022] GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8 => generated 1468 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:41.964405 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6f5452a8-9214-4987-9a78-41563c99c8bf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:41.965727 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6f5452a8-9214-4987-9a78-41563c99c8bf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:41.975115 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f5452a8-9214-4987-9a78-41563c99c8bf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:41.976339 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f5452a8-9214-4987-9a78-41563c99c8bf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:41.977027 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f5452a8-9214-4987-9a78-41563c99c8bf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:41.977961 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f5452a8-9214-4987-9a78-41563c99c8bf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:41.978617 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f5452a8-9214-4987-9a78-41563c99c8bf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:41.979280 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f5452a8-9214-4987-9a78-41563c99c8bf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:42.059266 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6f5452a8-9214-4987-9a78-41563c99c8bf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:42.068428 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6f5452a8-9214-4987-9a78-41563c99c8bf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed" status: 200 len: 1248 microversion: 2.1 time: 0.107998 Sep 07 15:58:42.068991 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 206/398] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:41 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed => generated 1248 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:42.290629 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d73c3b05-891a-45f5-9144-1c911b96a7f2 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:42.291409 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d73c3b05-891a-45f5-9144-1c911b96a7f2 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:42.305206 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d73c3b05-891a-45f5-9144-1c911b96a7f2 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:42.305206 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d73c3b05-891a-45f5-9144-1c911b96a7f2 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:42.305923 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d73c3b05-891a-45f5-9144-1c911b96a7f2 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:42.306136 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d73c3b05-891a-45f5-9144-1c911b96a7f2 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:42.306593 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d73c3b05-891a-45f5-9144-1c911b96a7f2 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:42.307043 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d73c3b05-891a-45f5-9144-1c911b96a7f2 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:42.461046 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-d73c3b05-891a-45f5-9144-1c911b96a7f2 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:42.471822 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d73c3b05-891a-45f5-9144-1c911b96a7f2 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1364 microversion: 2.1 time: 0.185447 Sep 07 15:58:42.472664 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 193/399] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:42 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1364 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:42.598553 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9d660b9f-78f0-4a40-8673-9f525fec1363 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:42.599419 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9d660b9f-78f0-4a40-8673-9f525fec1363 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] [instance: 22b4fa04-91a6-4b41-8a11-c545bca344a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:42.606161 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9d660b9f-78f0-4a40-8673-9f525fec1363 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:42.606993 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9d660b9f-78f0-4a40-8673-9f525fec1363 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:42.607622 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9d660b9f-78f0-4a40-8673-9f525fec1363 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:42.608315 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9d660b9f-78f0-4a40-8673-9f525fec1363 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:42.608917 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9d660b9f-78f0-4a40-8673-9f525fec1363 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:42.609489 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9d660b9f-78f0-4a40-8673-9f525fec1363 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:42.766680 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9d660b9f-78f0-4a40-8673-9f525fec1363 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ae4012f414796a9a82e177ce43af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0998ce41664645e6b2825dc435c8a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:42.776063 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9d660b9f-78f0-4a40-8673-9f525fec1363 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] 10.222.0.17 "GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8" status: 200 len: 1468 microversion: 2.1 time: 0.180785 Sep 07 15:58:42.788142 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 207/400] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:42 2022] GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8 => generated 1468 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:43.114773 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9dbcc22a-c4e6-41ac-b441-d2ebd3bf5e49 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:43.115449 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9dbcc22a-c4e6-41ac-b441-d2ebd3bf5e49 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:43.126945 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9dbcc22a-c4e6-41ac-b441-d2ebd3bf5e49 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:43.127466 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9dbcc22a-c4e6-41ac-b441-d2ebd3bf5e49 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:43.127936 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9dbcc22a-c4e6-41ac-b441-d2ebd3bf5e49 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:43.131053 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9dbcc22a-c4e6-41ac-b441-d2ebd3bf5e49 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:43.131053 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9dbcc22a-c4e6-41ac-b441-d2ebd3bf5e49 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:43.131053 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9dbcc22a-c4e6-41ac-b441-d2ebd3bf5e49 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:43.199617 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-9dbcc22a-c4e6-41ac-b441-d2ebd3bf5e49 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:43.225281 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9dbcc22a-c4e6-41ac-b441-d2ebd3bf5e49 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed" status: 200 len: 1248 microversion: 2.1 time: 0.134764 Sep 07 15:58:43.240232 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 194/401] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:43 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed => generated 1248 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:43.494957 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d8ed8875-b537-4527-b221-0383eb0d6383 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:43.495566 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d8ed8875-b537-4527-b221-0383eb0d6383 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:43.502524 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8ed8875-b537-4527-b221-0383eb0d6383 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:43.503862 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8ed8875-b537-4527-b221-0383eb0d6383 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:43.504515 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8ed8875-b537-4527-b221-0383eb0d6383 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:43.505396 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8ed8875-b537-4527-b221-0383eb0d6383 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:43.505844 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8ed8875-b537-4527-b221-0383eb0d6383 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:43.506300 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d8ed8875-b537-4527-b221-0383eb0d6383 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:43.658612 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d8ed8875-b537-4527-b221-0383eb0d6383 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:43.666868 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d8ed8875-b537-4527-b221-0383eb0d6383 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1364 microversion: 2.1 time: 0.175624 Sep 07 15:58:43.673433 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 208/402] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:43 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1364 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:43.798301 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-943b4fa2-6349-4ae7-b6f8-7746cf37d4a4 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:43.799567 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-943b4fa2-6349-4ae7-b6f8-7746cf37d4a4 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] [instance: 22b4fa04-91a6-4b41-8a11-c545bca344a8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:43.806151 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-943b4fa2-6349-4ae7-b6f8-7746cf37d4a4 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:43.806841 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-943b4fa2-6349-4ae7-b6f8-7746cf37d4a4 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:43.807450 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-943b4fa2-6349-4ae7-b6f8-7746cf37d4a4 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:43.808328 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-943b4fa2-6349-4ae7-b6f8-7746cf37d4a4 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:43.808965 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-943b4fa2-6349-4ae7-b6f8-7746cf37d4a4 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:43.809548 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-943b4fa2-6349-4ae7-b6f8-7746cf37d4a4 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:43.825405 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:43.956388 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-943b4fa2-6349-4ae7-b6f8-7746cf37d4a4 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ae4012f414796a9a82e177ce43af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0998ce41664645e6b2825dc435c8a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:43.964443 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-943b4fa2-6349-4ae7-b6f8-7746cf37d4a4 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] 10.222.0.17 "GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8" status: 200 len: 1468 microversion: 2.1 time: 0.170098 Sep 07 15:58:43.965088 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 195/403] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:43 2022] GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8 => generated 1468 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:58:44.253851 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8efe16b3-3ddd-4dba-a088-af14d6a79c05 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:44.255271 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8efe16b3-3ddd-4dba-a088-af14d6a79c05 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:44.264466 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8efe16b3-3ddd-4dba-a088-af14d6a79c05 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:44.265064 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8efe16b3-3ddd-4dba-a088-af14d6a79c05 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:44.265592 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8efe16b3-3ddd-4dba-a088-af14d6a79c05 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:44.266392 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8efe16b3-3ddd-4dba-a088-af14d6a79c05 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:44.266958 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8efe16b3-3ddd-4dba-a088-af14d6a79c05 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:44.267836 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8efe16b3-3ddd-4dba-a088-af14d6a79c05 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:44.369340 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-8efe16b3-3ddd-4dba-a088-af14d6a79c05 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:44.385728 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8efe16b3-3ddd-4dba-a088-af14d6a79c05 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed" status: 200 len: 1248 microversion: 2.1 time: 0.131357 Sep 07 15:58:44.386677 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 209/404] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:44 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed => generated 1248 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:44.697694 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1d2fac05-2267-4725-a3e5-b4dbba3ec35e tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:44.698218 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1d2fac05-2267-4725-a3e5-b4dbba3ec35e tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:44.705060 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1d2fac05-2267-4725-a3e5-b4dbba3ec35e tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:44.705726 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1d2fac05-2267-4725-a3e5-b4dbba3ec35e tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:44.706332 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1d2fac05-2267-4725-a3e5-b4dbba3ec35e tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:44.707046 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1d2fac05-2267-4725-a3e5-b4dbba3ec35e tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:44.707489 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1d2fac05-2267-4725-a3e5-b4dbba3ec35e tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:44.708100 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1d2fac05-2267-4725-a3e5-b4dbba3ec35e tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:44.846489 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-1d2fac05-2267-4725-a3e5-b4dbba3ec35e tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:44.859050 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1d2fac05-2267-4725-a3e5-b4dbba3ec35e tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1364 microversion: 2.1 time: 0.165724 Sep 07 15:58:44.859875 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 196/405] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:44 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:44.988391 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-69894f64-e7cb-4400-8d70-4608d3e3ae24 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:44.990566 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-69894f64-e7cb-4400-8d70-4608d3e3ae24 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] [instance: 22b4fa04-91a6-4b41-8a11-c545bca344a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:44.999169 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69894f64-e7cb-4400-8d70-4608d3e3ae24 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:45.000162 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69894f64-e7cb-4400-8d70-4608d3e3ae24 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:45.000763 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69894f64-e7cb-4400-8d70-4608d3e3ae24 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:45.001622 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69894f64-e7cb-4400-8d70-4608d3e3ae24 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:45.002218 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69894f64-e7cb-4400-8d70-4608d3e3ae24 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:45.002841 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-69894f64-e7cb-4400-8d70-4608d3e3ae24 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:45.170542 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-69894f64-e7cb-4400-8d70-4608d3e3ae24 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ae4012f414796a9a82e177ce43af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0998ce41664645e6b2825dc435c8a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:45.180150 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-69894f64-e7cb-4400-8d70-4608d3e3ae24 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] 10.222.0.17 "GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8" status: 200 len: 1468 microversion: 2.1 time: 0.195640 Sep 07 15:58:45.192203 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 210/406] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:44 2022] GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8 => generated 1468 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:45.411641 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3ffa1d4e-c7cb-40b7-b752-30c15529a168 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:45.412252 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3ffa1d4e-c7cb-40b7-b752-30c15529a168 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:45.418490 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3ffa1d4e-c7cb-40b7-b752-30c15529a168 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:45.418975 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3ffa1d4e-c7cb-40b7-b752-30c15529a168 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:45.419468 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3ffa1d4e-c7cb-40b7-b752-30c15529a168 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:45.420708 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3ffa1d4e-c7cb-40b7-b752-30c15529a168 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:45.421159 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3ffa1d4e-c7cb-40b7-b752-30c15529a168 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:45.421576 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3ffa1d4e-c7cb-40b7-b752-30c15529a168 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:45.490872 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-3ffa1d4e-c7cb-40b7-b752-30c15529a168 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:45.498655 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3ffa1d4e-c7cb-40b7-b752-30c15529a168 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed" status: 200 len: 1248 microversion: 2.1 time: 0.092838 Sep 07 15:58:45.499213 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 197/407] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:45 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed => generated 1248 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:45.893019 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9e1f0941-12cf-4b9f-8e59-73d54296be96 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:45.893692 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9e1f0941-12cf-4b9f-8e59-73d54296be96 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:45.920324 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e1f0941-12cf-4b9f-8e59-73d54296be96 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:45.921311 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e1f0941-12cf-4b9f-8e59-73d54296be96 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:45.921877 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e1f0941-12cf-4b9f-8e59-73d54296be96 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:45.922619 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e1f0941-12cf-4b9f-8e59-73d54296be96 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:45.925915 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e1f0941-12cf-4b9f-8e59-73d54296be96 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:45.925915 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e1f0941-12cf-4b9f-8e59-73d54296be96 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:46.079593 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9e1f0941-12cf-4b9f-8e59-73d54296be96 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:46.089602 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9e1f0941-12cf-4b9f-8e59-73d54296be96 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1364 microversion: 2.1 time: 0.200483 Sep 07 15:58:46.092880 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 211/408] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:45 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1364 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:46.206236 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a8a94b13-5a28-4591-a089-13d3d84083b5 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:46.206878 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a8a94b13-5a28-4591-a089-13d3d84083b5 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] [instance: 22b4fa04-91a6-4b41-8a11-c545bca344a8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:46.220630 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a8a94b13-5a28-4591-a089-13d3d84083b5 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:46.221457 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a8a94b13-5a28-4591-a089-13d3d84083b5 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:46.227690 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a8a94b13-5a28-4591-a089-13d3d84083b5 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:46.229100 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a8a94b13-5a28-4591-a089-13d3d84083b5 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:46.229883 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a8a94b13-5a28-4591-a089-13d3d84083b5 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:46.230632 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a8a94b13-5a28-4591-a089-13d3d84083b5 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:46.420774 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-a8a94b13-5a28-4591-a089-13d3d84083b5 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ae4012f414796a9a82e177ce43af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0998ce41664645e6b2825dc435c8a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:46.434671 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a8a94b13-5a28-4591-a089-13d3d84083b5 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] 10.222.0.17 "GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8" status: 200 len: 1468 microversion: 2.1 time: 0.230745 Sep 07 15:58:46.435678 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 198/409] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:46 2022] GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8 => generated 1468 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:46.522028 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3fdfdfaf-9f17-4000-b3cd-eb1da07a3641 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:46.522638 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3fdfdfaf-9f17-4000-b3cd-eb1da07a3641 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:46.538136 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3fdfdfaf-9f17-4000-b3cd-eb1da07a3641 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:46.538647 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3fdfdfaf-9f17-4000-b3cd-eb1da07a3641 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:46.539133 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3fdfdfaf-9f17-4000-b3cd-eb1da07a3641 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:46.539919 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3fdfdfaf-9f17-4000-b3cd-eb1da07a3641 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:46.540966 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3fdfdfaf-9f17-4000-b3cd-eb1da07a3641 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:46.548011 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3fdfdfaf-9f17-4000-b3cd-eb1da07a3641 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:46.668876 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3fdfdfaf-9f17-4000-b3cd-eb1da07a3641 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:46.679377 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3fdfdfaf-9f17-4000-b3cd-eb1da07a3641 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed" status: 200 len: 1296 microversion: 2.1 time: 0.161391 Sep 07 15:58:46.691651 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 212/410] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:46 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed => generated 1296 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:46.881667 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-1903d027-7239-4ec5-a5cf-aedc7eee87e6 req-05e36ed4-b266-4858-8f80-d51d187de084 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9f7188c-7dad-469c-b915-511d7f6f7a14", "name": "network-vif-plugged", "status": "completed", "tag": "e8ba6d47-0763-4132-b207-05e0e03c1ad9"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:58:46.894702 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-1903d027-7239-4ec5-a5cf-aedc7eee87e6 req-05e36ed4-b266-4858-8f80-d51d187de084 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:46.895289 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-1903d027-7239-4ec5-a5cf-aedc7eee87e6 req-05e36ed4-b266-4858-8f80-d51d187de084 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:46.896008 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-1903d027-7239-4ec5-a5cf-aedc7eee87e6 req-05e36ed4-b266-4858-8f80-d51d187de084 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:46.914484 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-1903d027-7239-4ec5-a5cf-aedc7eee87e6 req-05e36ed4-b266-4858-8f80-d51d187de084 service nova] Creating event network-vif-plugged:e8ba6d47-0763-4132-b207-05e0e03c1ad9 for instance d9f7188c-7dad-469c-b915-511d7f6f7a14 on hv-cinder-85331 Sep 07 15:58:46.923142 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-1903d027-7239-4ec5-a5cf-aedc7eee87e6 req-05e36ed4-b266-4858-8f80-d51d187de084 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048728 Sep 07 15:58:46.924346 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 199/411] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 15:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:58:47.118372 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fc9b91cc-b043-4550-8e86-546f36a0cbba tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:47.119754 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fc9b91cc-b043-4550-8e86-546f36a0cbba tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:47.139653 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc9b91cc-b043-4550-8e86-546f36a0cbba tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:47.141675 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc9b91cc-b043-4550-8e86-546f36a0cbba tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:47.142418 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc9b91cc-b043-4550-8e86-546f36a0cbba tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:47.144457 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc9b91cc-b043-4550-8e86-546f36a0cbba tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:47.150184 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc9b91cc-b043-4550-8e86-546f36a0cbba tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:47.151782 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc9b91cc-b043-4550-8e86-546f36a0cbba tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:47.459429 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8d2f52ff-4fb5-4560-a677-d348e233fbdb tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:47.461577 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8d2f52ff-4fb5-4560-a677-d348e233fbdb tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] [instance: 22b4fa04-91a6-4b41-8a11-c545bca344a8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:47.479962 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8d2f52ff-4fb5-4560-a677-d348e233fbdb tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:47.483433 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8d2f52ff-4fb5-4560-a677-d348e233fbdb tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:47.487131 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8d2f52ff-4fb5-4560-a677-d348e233fbdb tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:47.488427 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8d2f52ff-4fb5-4560-a677-d348e233fbdb tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:47.490084 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8d2f52ff-4fb5-4560-a677-d348e233fbdb tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:47.492118 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8d2f52ff-4fb5-4560-a677-d348e233fbdb tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:47.847061 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-fc9b91cc-b043-4550-8e86-546f36a0cbba tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:47.860962 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fc9b91cc-b043-4550-8e86-546f36a0cbba tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1364 microversion: 2.1 time: 0.746302 Sep 07 15:58:47.861779 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 213/412] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:47 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1364 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:47.866565 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d3ba52cf-5a32-4d38-8cf0-2dfdf0ab5bc9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:47.873122 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d3ba52cf-5a32-4d38-8cf0-2dfdf0ab5bc9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:47.889351 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3ba52cf-5a32-4d38-8cf0-2dfdf0ab5bc9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:47.893945 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3ba52cf-5a32-4d38-8cf0-2dfdf0ab5bc9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:47.895094 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3ba52cf-5a32-4d38-8cf0-2dfdf0ab5bc9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:47.900554 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3ba52cf-5a32-4d38-8cf0-2dfdf0ab5bc9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:47.903068 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3ba52cf-5a32-4d38-8cf0-2dfdf0ab5bc9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:47.904606 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3ba52cf-5a32-4d38-8cf0-2dfdf0ab5bc9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:48.300962 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d3ba52cf-5a32-4d38-8cf0-2dfdf0ab5bc9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:48.308696 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d3ba52cf-5a32-4d38-8cf0-2dfdf0ab5bc9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed" status: 200 len: 1302 microversion: 2.1 time: 0.445713 Sep 07 15:58:48.311859 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 214/413] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:47 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed => generated 1302 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:48.313164 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-8d2f52ff-4fb5-4560-a677-d348e233fbdb tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ae4012f414796a9a82e177ce43af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0998ce41664645e6b2825dc435c8a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:48.342469 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8d2f52ff-4fb5-4560-a677-d348e233fbdb tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] 10.222.0.17 "GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8" status: 200 len: 1468 microversion: 2.1 time: 0.886695 Sep 07 15:58:48.344007 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 200/414] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:47 2022] GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8 => generated 1468 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:48.432868 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-9ac913bc-6615-4d56-a881-5d0443b551ff req-ec5889a5-4b2e-404d-a34e-30fec9661d51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22b4fa04-91a6-4b41-8a11-c545bca344a8", "name": "network-vif-deleted", "tag": "ec56e8a9-c5e3-4861-bb4b-5279a8fb5849"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:58:48.447623 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9ac913bc-6615-4d56-a881-5d0443b551ff req-ec5889a5-4b2e-404d-a34e-30fec9661d51 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:48.453773 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9ac913bc-6615-4d56-a881-5d0443b551ff req-ec5889a5-4b2e-404d-a34e-30fec9661d51 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:48.454721 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9ac913bc-6615-4d56-a881-5d0443b551ff req-ec5889a5-4b2e-404d-a34e-30fec9661d51 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:48.468143 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-9ac913bc-6615-4d56-a881-5d0443b551ff req-ec5889a5-4b2e-404d-a34e-30fec9661d51 service nova] Creating event network-vif-deleted:ec56e8a9-c5e3-4861-bb4b-5279a8fb5849 for instance 22b4fa04-91a6-4b41-8a11-c545bca344a8 on hv-cinder-85331 Sep 07 15:58:48.473677 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-9ac913bc-6615-4d56-a881-5d0443b551ff req-ec5889a5-4b2e-404d-a34e-30fec9661d51 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044983 Sep 07 15:58:48.483368 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 215/415] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 15:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:58:48.884717 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cdee9db9-cb95-4601-92a7-be763f0280f9 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:48.886062 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cdee9db9-cb95-4601-92a7-be763f0280f9 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:48.896119 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cdee9db9-cb95-4601-92a7-be763f0280f9 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:48.898454 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cdee9db9-cb95-4601-92a7-be763f0280f9 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:48.907262 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cdee9db9-cb95-4601-92a7-be763f0280f9 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:48.908308 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cdee9db9-cb95-4601-92a7-be763f0280f9 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:48.908934 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cdee9db9-cb95-4601-92a7-be763f0280f9 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:48.909514 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cdee9db9-cb95-4601-92a7-be763f0280f9 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:49.339162 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-65632f76-343e-43e0-8888-c9b5dc1a569d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:49.340499 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-65632f76-343e-43e0-8888-c9b5dc1a569d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:49.351232 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65632f76-343e-43e0-8888-c9b5dc1a569d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:49.359372 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65632f76-343e-43e0-8888-c9b5dc1a569d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:49.360539 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65632f76-343e-43e0-8888-c9b5dc1a569d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:49.360909 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65632f76-343e-43e0-8888-c9b5dc1a569d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:49.361405 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65632f76-343e-43e0-8888-c9b5dc1a569d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:49.361796 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-65632f76-343e-43e0-8888-c9b5dc1a569d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:49.533486 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-cdee9db9-cb95-4601-92a7-be763f0280f9 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:49.556128 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cdee9db9-cb95-4601-92a7-be763f0280f9 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1364 microversion: 2.1 time: 0.672451 Sep 07 15:58:49.567635 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 201/416] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:48 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1364 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:49.582901 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-39a3930b-db1f-4ecc-a5e8-39882c15161a tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:49.595354 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-39a3930b-db1f-4ecc-a5e8-39882c15161a tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] [instance: 22b4fa04-91a6-4b41-8a11-c545bca344a8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:49.608606 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-39a3930b-db1f-4ecc-a5e8-39882c15161a tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:49.609274 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-39a3930b-db1f-4ecc-a5e8-39882c15161a tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:49.609783 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-39a3930b-db1f-4ecc-a5e8-39882c15161a tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:49.610605 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-39a3930b-db1f-4ecc-a5e8-39882c15161a tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:49.611133 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-39a3930b-db1f-4ecc-a5e8-39882c15161a tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:49.611648 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-39a3930b-db1f-4ecc-a5e8-39882c15161a tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:49.643606 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-65632f76-343e-43e0-8888-c9b5dc1a569d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:49.653242 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-65632f76-343e-43e0-8888-c9b5dc1a569d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed" status: 200 len: 1370 microversion: 2.1 time: 0.318185 Sep 07 15:58:49.656094 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 216/417] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:49 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed => generated 1370 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:49.750268 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-39a3930b-db1f-4ecc-a5e8-39882c15161a tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ae4012f414796a9a82e177ce43af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0998ce41664645e6b2825dc435c8a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:49.768142 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-39a3930b-db1f-4ecc-a5e8-39882c15161a tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] 10.222.0.17 "GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8" status: 200 len: 1299 microversion: 2.1 time: 0.194298 Sep 07 15:58:49.771353 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 202/418] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:49 2022] GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8 => generated 1299 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:50.583264 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1e6e7a8e-6cba-465b-9ded-f0a10c52687b tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:50.584508 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1e6e7a8e-6cba-465b-9ded-f0a10c52687b tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:50.591952 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e6e7a8e-6cba-465b-9ded-f0a10c52687b tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:50.592742 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e6e7a8e-6cba-465b-9ded-f0a10c52687b tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:50.593386 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e6e7a8e-6cba-465b-9ded-f0a10c52687b tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:50.594644 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e6e7a8e-6cba-465b-9ded-f0a10c52687b tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:50.595315 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e6e7a8e-6cba-465b-9ded-f0a10c52687b tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:50.595978 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e6e7a8e-6cba-465b-9ded-f0a10c52687b tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:50.680431 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-41dfc589-9cfc-42de-8d62-a029dd80c401 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:50.681756 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-41dfc589-9cfc-42de-8d62-a029dd80c401 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:50.723000 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-41dfc589-9cfc-42de-8d62-a029dd80c401 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:50.723000 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-41dfc589-9cfc-42de-8d62-a029dd80c401 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:50.726380 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:50.728028 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-41dfc589-9cfc-42de-8d62-a029dd80c401 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:50.729704 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-41dfc589-9cfc-42de-8d62-a029dd80c401 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:50.740880 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-41dfc589-9cfc-42de-8d62-a029dd80c401 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:50.741559 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=10 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:50.744170 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-41dfc589-9cfc-42de-8d62-a029dd80c401 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:50.931409 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:50.970594 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1e6e7a8e-6cba-465b-9ded-f0a10c52687b tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:50.983477 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1e6e7a8e-6cba-465b-9ded-f0a10c52687b tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1364 microversion: 2.1 time: 0.405376 Sep 07 15:58:51.001999 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 217/419] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:50 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1364 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:51.016744 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-72c52de6-0e75-4603-9dbf-d3974194a728 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:51.019463 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-72c52de6-0e75-4603-9dbf-d3974194a728 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] [instance: 22b4fa04-91a6-4b41-8a11-c545bca344a8] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:51.038144 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-72c52de6-0e75-4603-9dbf-d3974194a728 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:51.038921 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-72c52de6-0e75-4603-9dbf-d3974194a728 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:51.040203 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-72c52de6-0e75-4603-9dbf-d3974194a728 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:51.045185 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-72c52de6-0e75-4603-9dbf-d3974194a728 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:51.045997 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-72c52de6-0e75-4603-9dbf-d3974194a728 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:51.046797 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-72c52de6-0e75-4603-9dbf-d3974194a728 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:51.103319 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-72c52de6-0e75-4603-9dbf-d3974194a728 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:51.104219 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-72c52de6-0e75-4603-9dbf-d3974194a728 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:51.104875 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-72c52de6-0e75-4603-9dbf-d3974194a728 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:51.105476 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-72c52de6-0e75-4603-9dbf-d3974194a728 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lazy-loading 'fault' on Instance uuid 22b4fa04-91a6-4b41-8a11-c545bca344a8 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 15:58:51.168267 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-41dfc589-9cfc-42de-8d62-a029dd80c401 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:51.169484 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-72c52de6-0e75-4603-9dbf-d3974194a728 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ae4012f414796a9a82e177ce43af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0998ce41664645e6b2825dc435c8a4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:51.180207 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-72c52de6-0e75-4603-9dbf-d3974194a728 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] 10.222.0.17 "GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8" status: 200 len: 1304 microversion: 2.1 time: 0.175291 Sep 07 15:58:51.181335 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 218/420] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:51 2022] GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8 => generated 1304 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:51.184321 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-41dfc589-9cfc-42de-8d62-a029dd80c401 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed" status: 200 len: 1370 microversion: 2.1 time: 0.509952 Sep 07 15:58:51.185037 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 203/421] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:50 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed => generated 1370 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:58:51.186462 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-d1f7c2d8-27a6-4f1a-96a5-c0f1b97805e3 req-6baf56dd-3911-4cd8-9628-08a185034a8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92a9f013-5f7f-442b-84d8-f61470d999ed", "tag": "a060693c-99c1-4033-a3a8-1384e673c07a"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:58:51.192914 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:51.200201 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d1f7c2d8-27a6-4f1a-96a5-c0f1b97805e3 req-6baf56dd-3911-4cd8-9628-08a185034a8f service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:51.201935 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d1f7c2d8-27a6-4f1a-96a5-c0f1b97805e3 req-6baf56dd-3911-4cd8-9628-08a185034a8f service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:51.202577 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d1f7c2d8-27a6-4f1a-96a5-c0f1b97805e3 req-6baf56dd-3911-4cd8-9628-08a185034a8f service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:51.218307 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-d1f7c2d8-27a6-4f1a-96a5-c0f1b97805e3 req-6baf56dd-3911-4cd8-9628-08a185034a8f service nova] Creating event network-changed:a060693c-99c1-4033-a3a8-1384e673c07a for instance 92a9f013-5f7f-442b-84d8-f61470d999ed on hv-cinder-85331 Sep 07 15:58:51.226720 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-d1f7c2d8-27a6-4f1a-96a5-c0f1b97805e3 req-6baf56dd-3911-4cd8-9628-08a185034a8f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044312 Sep 07 15:58:51.230397 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 219/422] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 15:58:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:58:51.304508 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a45fb9c5-47fc-4b66-bebd-ba9003bb252f tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Action: 'create', calling method: .version_select at 0x7ff9a5e071f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-215252029", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7hBXzXIGZekYV+1SXuZu4xGvydqMOuDe6h41YJrZTUcvyI8o4GXHKS2VDkVxe6e9KbimreuoSix9he3xtRmKVV9NKA6Ho46IIL9iYpu4adYxutI6ZNPPtbcVJUvmK/ag=="}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:58:51.317489 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:51.329228 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.quota [None req-a45fb9c5-47fc-4b66-bebd-ba9003bb252f tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Getting quotas for project e0fa130dded4449b88e5d696f57a6a1d. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 15:58:51.350336 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.quota [None req-a45fb9c5-47fc-4b66-bebd-ba9003bb252f tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Getting quotas for user c1320dca5c1840f9af2418e705e8aaa1 and project e0fa130dded4449b88e5d696f57a6a1d. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 15:58:51.376280 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a45fb9c5-47fc-4b66-bebd-ba9003bb252f tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.075720 Sep 07 15:58:51.376871 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 204/423] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Sep 7 15:58:51 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:58:51.510102 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1779948b-e477-4be3-ad7b-e3d8c55c5df4 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1637825362", "imageRef": "b44bdd5c-cf79-419d-bf5f-177f2d5373b9", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-215252029", "networks": [{"uuid": "2c72b365-631f-43ac-8051-c97e34739f1d"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:58:51.567020 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-1779948b-e477-4be3-ad7b-e3d8c55c5df4 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] validate_networks() for [('2c72b365-631f-43ac-8051-c97e34739f1d', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 15:58:52.011288 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-17d606a3-d796-4776-a654-1d868b3553d8 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:52.011906 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-17d606a3-d796-4776-a654-1d868b3553d8 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:52.021052 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-17d606a3-d796-4776-a654-1d868b3553d8 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:52.021901 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-17d606a3-d796-4776-a654-1d868b3553d8 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:52.022719 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-17d606a3-d796-4776-a654-1d868b3553d8 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:52.023670 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-17d606a3-d796-4776-a654-1d868b3553d8 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:52.024342 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-17d606a3-d796-4776-a654-1d868b3553d8 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:52.025217 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-17d606a3-d796-4776-a654-1d868b3553d8 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:52.058244 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-1779948b-e477-4be3-ad7b-e3d8c55c5df4 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 15:58:52.058946 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-1779948b-e477-4be3-ad7b-e3d8c55c5df4 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 15:58:52.059594 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-1779948b-e477-4be3-ad7b-e3d8c55c5df4 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 15:58:52.060346 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-1779948b-e477-4be3-ad7b-e3d8c55c5df4 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 15:58:52.060904 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-1779948b-e477-4be3-ad7b-e3d8c55c5df4 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 15:58:52.075971 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1779948b-e477-4be3-ad7b-e3d8c55c5df4 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:52.076873 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1779948b-e477-4be3-ad7b-e3d8c55c5df4 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:52.077454 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1779948b-e477-4be3-ad7b-e3d8c55c5df4 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:52.078328 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1779948b-e477-4be3-ad7b-e3d8c55c5df4 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:52.079240 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1779948b-e477-4be3-ad7b-e3d8c55c5df4 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:52.079847 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1779948b-e477-4be3-ad7b-e3d8c55c5df4 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:52.110043 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-1779948b-e477-4be3-ad7b-e3d8c55c5df4 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Getting quotas for project e0fa130dded4449b88e5d696f57a6a1d. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 15:58:52.115060 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-1779948b-e477-4be3-ad7b-e3d8c55c5df4 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Getting quotas for user c1320dca5c1840f9af2418e705e8aaa1 and project e0fa130dded4449b88e5d696f57a6a1d. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 15:58:52.138002 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1779948b-e477-4be3-ad7b-e3d8c55c5df4 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 15:58:52.141823 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1779948b-e477-4be3-ad7b-e3d8c55c5df4 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b44bdd5c-cf79-419d-bf5f-177f2d5373b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 15:58:52.231865 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1779948b-e477-4be3-ad7b-e3d8c55c5df4 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.725969 Sep 07 15:58:52.232812 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 220/424] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Sep 7 15:58:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 15:58:52.241599 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ff9813ae-a50d-4c72-8fed-33e679f81078 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:52.247005 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ff9813ae-a50d-4c72-8fed-33e679f81078 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:52.293788 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff9813ae-a50d-4c72-8fed-33e679f81078 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:52.295202 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff9813ae-a50d-4c72-8fed-33e679f81078 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:52.295770 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff9813ae-a50d-4c72-8fed-33e679f81078 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:52.296585 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff9813ae-a50d-4c72-8fed-33e679f81078 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:52.297164 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff9813ae-a50d-4c72-8fed-33e679f81078 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:52.298101 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ff9813ae-a50d-4c72-8fed-33e679f81078 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:52.307891 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-17d606a3-d796-4776-a654-1d868b3553d8 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:52.316593 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-17d606a3-d796-4776-a654-1d868b3553d8 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1551 microversion: 2.1 time: 0.309814 Sep 07 15:58:52.334597 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 205/425] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:52 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1551 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:52.346367 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f61b27a5-b198-45a3-aa86-72b26435c944 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:52.347091 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f61b27a5-b198-45a3-aa86-72b26435c944 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] [instance: 22b4fa04-91a6-4b41-8a11-c545bca344a8] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:52.354868 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f61b27a5-b198-45a3-aa86-72b26435c944 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:52.355358 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f61b27a5-b198-45a3-aa86-72b26435c944 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:52.355824 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f61b27a5-b198-45a3-aa86-72b26435c944 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:52.356525 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f61b27a5-b198-45a3-aa86-72b26435c944 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:52.357011 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f61b27a5-b198-45a3-aa86-72b26435c944 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:52.357763 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f61b27a5-b198-45a3-aa86-72b26435c944 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:52.392797 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-f61b27a5-b198-45a3-aa86-72b26435c944 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] HTTP exception thrown: Instance 22b4fa04-91a6-4b41-8a11-c545bca344a8 could not be found. Sep 07 15:58:52.398523 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f61b27a5-b198-45a3-aa86-72b26435c944 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Request method failure captured: Sep 07 15:58:52.398523 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8 HTTP/1.1 Sep 07 15:58:52.398523 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Accept: application/json Sep 07 15:58:52.398523 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Accept-Encoding: identity Sep 07 15:58:52.398523 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Connection: close Sep 07 15:58:52.398523 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Content-Length: 0 Sep 07 15:58:52.398523 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Content-Type: application/json Sep 07 15:58:52.398523 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Host: 10.222.0.17 Sep 07 15:58:52.398523 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Openstack-System-Scope: None Sep 07 15:58:52.398523 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Sep 07 15:58:52.398523 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjGL-QHuevD8yhealjKtzjWlacez7xbY6QNSSFg4RwQb546dduiqqLgm9jSKZETPC4aP8J6TcGeFA1R_ZHeL-F-xS2KXPb3lX5tIG-ydF6SFzuZ3PNQJITEmDBUBUyEaJRP-9yVmDpU0rOJiLCqGLDzDDrFtx75B3-blJPIUZz9O1zRvA Sep 07 15:58:52.398523 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Domain-Id: None Sep 07 15:58:52.398523 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Domain-Name: None Sep 07 15:58:52.398523 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Identity-Status: Confirmed Sep 07 15:58:52.398523 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Is-Admin-Project: True Sep 07 15:58:52.398523 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Domain-Id: default Sep 07 15:58:52.398523 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Domain-Name: Default Sep 07 15:58:52.398523 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Id: 0998ce41664645e6b2825dc435c8a4c2 Sep 07 15:58:52.398523 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Name: tempest-VolumesNegativeTest-1189803026 Sep 07 15:58:52.398523 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Role: reader,member Sep 07 15:58:52.398523 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Roles: reader,member Sep 07 15:58:52.400162 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0998ce41664645e6b2825dc435c8a4c2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0998ce41664645e6b2825dc435c8a4c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0998ce41664645e6b2825dc435c8a4c2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0998ce41664645e6b2825dc435c8a4c2"}]}] Sep 07 15:58:52.400162 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant: tempest-VolumesNegativeTest-1189803026 Sep 07 15:58:52.400162 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant-Id: 0998ce41664645e6b2825dc435c8a4c2 Sep 07 15:58:52.400162 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant-Name: tempest-VolumesNegativeTest-1189803026 Sep 07 15:58:52.400162 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User: tempest-VolumesNegativeTest-1189803026-project Sep 07 15:58:52.400162 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Domain-Id: default Sep 07 15:58:52.400162 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Domain-Name: Default Sep 07 15:58:52.400162 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Id: 055ae4012f414796a9a82e177ce43af7 Sep 07 15:58:52.400162 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Name: tempest-VolumesNegativeTest-1189803026-project Sep 07 15:58:52.400162 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: method: > Sep 07 15:58:52.400162 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: exception: Instance 22b4fa04-91a6-4b41-8a11-c545bca344a8 could not be found. Sep 07 15:58:52.400162 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: action_args: {'id': '22b4fa04-91a6-4b41-8a11-c545bca344a8'} Sep 07 15:58:52.401090 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 15:58:52.401090 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:58:52.401090 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 15:58:52.401090 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 15:58:52.401090 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 15:58:52.401090 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 15:58:52.401090 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 15:58:52.401090 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 15:58:52.401090 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 15:58:52.401090 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 15:58:52.401090 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22b4fa04-91a6-4b41-8a11-c545bca344a8 could not be found. Sep 07 15:58:52.401090 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 15:58:52.401090 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 15:58:52.401090 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 15:58:52.401090 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:58:52.401090 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 15:58:52.401090 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 15:58:52.401090 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 15:58:52.401090 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 15:58:52.401090 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 15:58:52.402545 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 15:58:52.402545 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 15:58:52.402545 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 15:58:52.402545 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 15:58:52.402545 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 15:58:52.402545 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 15:58:52.402545 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 15:58:52.402545 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22b4fa04-91a6-4b41-8a11-c545bca344a8 could not be found. Sep 07 15:58:52.402545 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 15:58:52.402545 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 15:58:52.402545 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 15:58:52.402545 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 15:58:52.402545 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 15:58:52.402545 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 15:58:52.402545 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 15:58:52.402545 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 15:58:52.402545 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22b4fa04-91a6-4b41-8a11-c545bca344a8 could not be found. Sep 07 15:58:52.402545 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 15:58:52.405950 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f61b27a5-b198-45a3-aa86-72b26435c944 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] Returning 404 to user: Instance 22b4fa04-91a6-4b41-8a11-c545bca344a8 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 15:58:52.409204 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f61b27a5-b198-45a3-aa86-72b26435c944 tempest-VolumesNegativeTest-1189803026 tempest-VolumesNegativeTest-1189803026-project] 10.222.0.17 "GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8" status: 404 len: 111 microversion: 2.1 time: 0.068152 Sep 07 15:58:52.411555 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 206/426] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:52 2022] GET /compute/v2.1/servers/22b4fa04-91a6-4b41-8a11-c545bca344a8 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 15:58:52.416462 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0934f127-d8d1-4680-9abd-3c0cba6d69af tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:52.419799 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0934f127-d8d1-4680-9abd-3c0cba6d69af tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:52.552305 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-0934f127-d8d1-4680-9abd-3c0cba6d69af tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:52.561688 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0934f127-d8d1-4680-9abd-3c0cba6d69af tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1258 microversion: 2.1 time: 0.148760 Sep 07 15:58:52.576448 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 207/427] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:52 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1258 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:52.583734 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-847a52dd-95c7-4181-b485-a20558adcb9d tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:52.584345 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-847a52dd-95c7-4181-b485-a20558adcb9d tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:52.592813 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-847a52dd-95c7-4181-b485-a20558adcb9d tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:52.593637 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-847a52dd-95c7-4181-b485-a20558adcb9d tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:52.594311 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-847a52dd-95c7-4181-b485-a20558adcb9d tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:52.595256 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-847a52dd-95c7-4181-b485-a20558adcb9d tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:52.596080 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-847a52dd-95c7-4181-b485-a20558adcb9d tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:52.596743 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-847a52dd-95c7-4181-b485-a20558adcb9d tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:52.634464 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ff9813ae-a50d-4c72-8fed-33e679f81078 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:52.645769 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ff9813ae-a50d-4c72-8fed-33e679f81078 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed" status: 200 len: 1370 microversion: 2.1 time: 0.411422 Sep 07 15:58:52.646328 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 221/428] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:52 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed => generated 1370 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:52.727274 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-847a52dd-95c7-4181-b485-a20558adcb9d tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.149519 Sep 07 15:58:52.735577 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 208/429] 10.222.0.17 () {58 vars in 1275 bytes} [Wed Sep 7 15:58:52 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14/os-interface => generated 285 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:58:53.589380 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-67361654-879f-491b-95a5-7f30e4700663 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:53.589999 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-67361654-879f-491b-95a5-7f30e4700663 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:53.601697 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67361654-879f-491b-95a5-7f30e4700663 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:53.602436 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67361654-879f-491b-95a5-7f30e4700663 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:53.603054 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67361654-879f-491b-95a5-7f30e4700663 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:53.603954 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67361654-879f-491b-95a5-7f30e4700663 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:53.604566 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67361654-879f-491b-95a5-7f30e4700663 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:53.605149 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-67361654-879f-491b-95a5-7f30e4700663 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:53.639947 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:53.674051 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c04c603b-bec4-4ad0-a191-305f41b64f41 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:53.675345 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c04c603b-bec4-4ad0-a191-305f41b64f41 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:53.683406 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c04c603b-bec4-4ad0-a191-305f41b64f41 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:53.684201 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c04c603b-bec4-4ad0-a191-305f41b64f41 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:53.685360 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c04c603b-bec4-4ad0-a191-305f41b64f41 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:53.686245 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c04c603b-bec4-4ad0-a191-305f41b64f41 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:53.686850 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c04c603b-bec4-4ad0-a191-305f41b64f41 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:53.687434 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c04c603b-bec4-4ad0-a191-305f41b64f41 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:53.722745 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-67361654-879f-491b-95a5-7f30e4700663 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:53.732935 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-67361654-879f-491b-95a5-7f30e4700663 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1262 microversion: 2.1 time: 0.147810 Sep 07 15:58:53.733506 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 222/430] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:53 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1262 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:53.873876 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-c04c603b-bec4-4ad0-a191-305f41b64f41 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:53.885808 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c04c603b-bec4-4ad0-a191-305f41b64f41 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed" status: 200 len: 1370 microversion: 2.1 time: 0.220140 Sep 07 15:58:53.888472 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 209/431] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:53 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed => generated 1370 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:58:54.126696 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-590f9b26-f8a2-4821-a97b-b0a8509ee342 req-381d885e-d359-41d1-8521-dfecd48e3f73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9f7188c-7dad-469c-b915-511d7f6f7a14", "tag": "e8ba6d47-0763-4132-b207-05e0e03c1ad9"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:58:54.139305 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-590f9b26-f8a2-4821-a97b-b0a8509ee342 req-381d885e-d359-41d1-8521-dfecd48e3f73 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:54.139816 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-590f9b26-f8a2-4821-a97b-b0a8509ee342 req-381d885e-d359-41d1-8521-dfecd48e3f73 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:54.140224 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-590f9b26-f8a2-4821-a97b-b0a8509ee342 req-381d885e-d359-41d1-8521-dfecd48e3f73 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:54.152506 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-590f9b26-f8a2-4821-a97b-b0a8509ee342 req-381d885e-d359-41d1-8521-dfecd48e3f73 service nova] Creating event network-changed:e8ba6d47-0763-4132-b207-05e0e03c1ad9 for instance d9f7188c-7dad-469c-b915-511d7f6f7a14 on hv-cinder-85331 Sep 07 15:58:54.161890 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-590f9b26-f8a2-4821-a97b-b0a8509ee342 req-381d885e-d359-41d1-8521-dfecd48e3f73 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040784 Sep 07 15:58:54.163104 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 223/432] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 15:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:58:54.764107 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-21b7af57-eb5f-4e4d-820b-d9cb45f0228e tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:54.765352 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-21b7af57-eb5f-4e4d-820b-d9cb45f0228e tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:54.772797 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-21b7af57-eb5f-4e4d-820b-d9cb45f0228e tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:54.775718 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-21b7af57-eb5f-4e4d-820b-d9cb45f0228e tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:54.779795 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-21b7af57-eb5f-4e4d-820b-d9cb45f0228e tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:54.780769 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-21b7af57-eb5f-4e4d-820b-d9cb45f0228e tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:54.782630 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-21b7af57-eb5f-4e4d-820b-d9cb45f0228e tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:54.783822 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-21b7af57-eb5f-4e4d-820b-d9cb45f0228e tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:54.882391 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-21b7af57-eb5f-4e4d-820b-d9cb45f0228e tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:54.890439 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-21b7af57-eb5f-4e4d-820b-d9cb45f0228e tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1262 microversion: 2.1 time: 0.130100 Sep 07 15:58:54.891291 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 210/433] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:54 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1262 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:58:54.920782 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c8ca6fcb-4f2e-4223-8013-781df36a6373 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:54.922198 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c8ca6fcb-4f2e-4223-8013-781df36a6373 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:54.928954 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c8ca6fcb-4f2e-4223-8013-781df36a6373 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:54.929862 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c8ca6fcb-4f2e-4223-8013-781df36a6373 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:54.930860 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c8ca6fcb-4f2e-4223-8013-781df36a6373 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:54.931797 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c8ca6fcb-4f2e-4223-8013-781df36a6373 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:54.932458 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c8ca6fcb-4f2e-4223-8013-781df36a6373 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:54.933112 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c8ca6fcb-4f2e-4223-8013-781df36a6373 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:55.133257 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c8ca6fcb-4f2e-4223-8013-781df36a6373 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:55.147854 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c8ca6fcb-4f2e-4223-8013-781df36a6373 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed" status: 200 len: 1370 microversion: 2.1 time: 0.234823 Sep 07 15:58:55.149570 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 224/434] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:54 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed => generated 1370 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:55.917037 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-aea4e8eb-c1e1-4a7c-8bb7-d79076f248b7 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:55.917645 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-aea4e8eb-c1e1-4a7c-8bb7-d79076f248b7 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:55.931113 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aea4e8eb-c1e1-4a7c-8bb7-d79076f248b7 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:55.932922 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aea4e8eb-c1e1-4a7c-8bb7-d79076f248b7 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:55.935814 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aea4e8eb-c1e1-4a7c-8bb7-d79076f248b7 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:55.940272 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aea4e8eb-c1e1-4a7c-8bb7-d79076f248b7 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:55.940968 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aea4e8eb-c1e1-4a7c-8bb7-d79076f248b7 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:55.954392 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aea4e8eb-c1e1-4a7c-8bb7-d79076f248b7 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:56.089465 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-aea4e8eb-c1e1-4a7c-8bb7-d79076f248b7 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:56.097817 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-aea4e8eb-c1e1-4a7c-8bb7-d79076f248b7 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1310 microversion: 2.1 time: 0.184864 Sep 07 15:58:56.098365 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 211/435] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:55 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1310 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:56.175629 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1974f5cc-2d1b-41dc-8845-ba6b3fa4c66c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:56.176767 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1974f5cc-2d1b-41dc-8845-ba6b3fa4c66c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:56.184273 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1974f5cc-2d1b-41dc-8845-ba6b3fa4c66c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:56.189332 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1974f5cc-2d1b-41dc-8845-ba6b3fa4c66c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:56.189997 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1974f5cc-2d1b-41dc-8845-ba6b3fa4c66c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:56.190845 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1974f5cc-2d1b-41dc-8845-ba6b3fa4c66c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:56.191312 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1974f5cc-2d1b-41dc-8845-ba6b3fa4c66c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:56.192029 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1974f5cc-2d1b-41dc-8845-ba6b3fa4c66c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:56.523328 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1974f5cc-2d1b-41dc-8845-ba6b3fa4c66c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:56.546557 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1974f5cc-2d1b-41dc-8845-ba6b3fa4c66c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed" status: 200 len: 1370 microversion: 2.1 time: 0.375038 Sep 07 15:58:56.548331 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 225/436] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:56 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed => generated 1370 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:57.123758 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4e1ccf3f-b61b-4dad-a6de-077d86976ac1 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:57.125021 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4e1ccf3f-b61b-4dad-a6de-077d86976ac1 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:57.141587 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e1ccf3f-b61b-4dad-a6de-077d86976ac1 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:57.142427 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e1ccf3f-b61b-4dad-a6de-077d86976ac1 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:57.143347 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e1ccf3f-b61b-4dad-a6de-077d86976ac1 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:57.145459 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e1ccf3f-b61b-4dad-a6de-077d86976ac1 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:57.147006 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e1ccf3f-b61b-4dad-a6de-077d86976ac1 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:57.147780 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4e1ccf3f-b61b-4dad-a6de-077d86976ac1 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:57.284028 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-4e1ccf3f-b61b-4dad-a6de-077d86976ac1 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:57.295630 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4e1ccf3f-b61b-4dad-a6de-077d86976ac1 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1316 microversion: 2.1 time: 0.176893 Sep 07 15:58:57.305117 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 212/437] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:57 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1316 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:57.578147 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-66022b23-bd86-4c89-aa71-0d7117ea4e38 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:57.579335 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-66022b23-bd86-4c89-aa71-0d7117ea4e38 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:57.593465 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66022b23-bd86-4c89-aa71-0d7117ea4e38 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:57.594359 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66022b23-bd86-4c89-aa71-0d7117ea4e38 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:57.594991 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66022b23-bd86-4c89-aa71-0d7117ea4e38 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:57.595899 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66022b23-bd86-4c89-aa71-0d7117ea4e38 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:57.596507 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66022b23-bd86-4c89-aa71-0d7117ea4e38 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:57.597078 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-66022b23-bd86-4c89-aa71-0d7117ea4e38 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:58.320658 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-825c0dad-8ef9-42e7-9335-34304e92c605 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:58.322227 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-825c0dad-8ef9-42e7-9335-34304e92c605 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:58.340163 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-825c0dad-8ef9-42e7-9335-34304e92c605 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:58.340665 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-825c0dad-8ef9-42e7-9335-34304e92c605 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:58.343865 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-825c0dad-8ef9-42e7-9335-34304e92c605 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:58.346105 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-825c0dad-8ef9-42e7-9335-34304e92c605 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:58.347623 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-825c0dad-8ef9-42e7-9335-34304e92c605 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:58.348085 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-825c0dad-8ef9-42e7-9335-34304e92c605 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:58.457418 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-66022b23-bd86-4c89-aa71-0d7117ea4e38 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:58.472619 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-66022b23-bd86-4c89-aa71-0d7117ea4e38 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed" status: 200 len: 1370 microversion: 2.1 time: 0.899733 Sep 07 15:58:58.489001 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 226/438] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:57 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed => generated 1370 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:58.730591 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-825c0dad-8ef9-42e7-9335-34304e92c605 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:58.744697 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-825c0dad-8ef9-42e7-9335-34304e92c605 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1358 microversion: 2.1 time: 0.427946 Sep 07 15:58:58.745923 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 213/439] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:58 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1358 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:59.498430 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-34a7bd2e-9375-4ce7-85bb-096a37295e0d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:59.499043 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-34a7bd2e-9375-4ce7-85bb-096a37295e0d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:59.516145 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34a7bd2e-9375-4ce7-85bb-096a37295e0d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:59.517044 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34a7bd2e-9375-4ce7-85bb-096a37295e0d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:59.517906 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34a7bd2e-9375-4ce7-85bb-096a37295e0d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:59.518900 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34a7bd2e-9375-4ce7-85bb-096a37295e0d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:59.519615 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34a7bd2e-9375-4ce7-85bb-096a37295e0d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:59.520336 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34a7bd2e-9375-4ce7-85bb-096a37295e0d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:59.770461 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-98571fdf-3401-4c70-97e4-4fe48391afec tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:58:59.771084 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-34a7bd2e-9375-4ce7-85bb-096a37295e0d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:59.772081 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-98571fdf-3401-4c70-97e4-4fe48391afec tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:58:59.782000 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-34a7bd2e-9375-4ce7-85bb-096a37295e0d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed" status: 200 len: 1370 microversion: 2.1 time: 0.287448 Sep 07 15:58:59.788074 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-98571fdf-3401-4c70-97e4-4fe48391afec tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:59.789093 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-98571fdf-3401-4c70-97e4-4fe48391afec tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:59.789797 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-98571fdf-3401-4c70-97e4-4fe48391afec tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:59.790848 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-98571fdf-3401-4c70-97e4-4fe48391afec tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:58:59.799737 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-98571fdf-3401-4c70-97e4-4fe48391afec tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:58:59.800559 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-98571fdf-3401-4c70-97e4-4fe48391afec tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:58:59.804320 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 227/440] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:59 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed => generated 1370 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:58:59.985866 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-98571fdf-3401-4c70-97e4-4fe48391afec tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:58:59.995766 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-98571fdf-3401-4c70-97e4-4fe48391afec tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1358 microversion: 2.1 time: 0.229208 Sep 07 15:59:00.009847 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 214/441] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:58:59 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1358 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:59:00.060345 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-d10b7abc-a3e1-4fe7-9f54-2b80ee065876 req-46d10154-c4eb-40fb-909f-29d97d27bfec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92a9f013-5f7f-442b-84d8-f61470d999ed", "name": "network-vif-plugged", "status": "completed", "tag": "a060693c-99c1-4033-a3a8-1384e673c07a"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:59:00.085560 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d10b7abc-a3e1-4fe7-9f54-2b80ee065876 req-46d10154-c4eb-40fb-909f-29d97d27bfec service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:00.087200 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d10b7abc-a3e1-4fe7-9f54-2b80ee065876 req-46d10154-c4eb-40fb-909f-29d97d27bfec service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:00.088149 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-d10b7abc-a3e1-4fe7-9f54-2b80ee065876 req-46d10154-c4eb-40fb-909f-29d97d27bfec service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:00.116373 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-d10b7abc-a3e1-4fe7-9f54-2b80ee065876 req-46d10154-c4eb-40fb-909f-29d97d27bfec service nova] Creating event network-vif-plugged:a060693c-99c1-4033-a3a8-1384e673c07a for instance 92a9f013-5f7f-442b-84d8-f61470d999ed on hv-cinder-85331 Sep 07 15:59:00.129468 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-d10b7abc-a3e1-4fe7-9f54-2b80ee065876 req-46d10154-c4eb-40fb-909f-29d97d27bfec service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072743 Sep 07 15:59:00.131603 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 228/442] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 15:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:59:00.811152 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-361c95c9-31dd-4fdb-a2c7-804346c51fd8 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:00.811801 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-361c95c9-31dd-4fdb-a2c7-804346c51fd8 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:00.827158 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-361c95c9-31dd-4fdb-a2c7-804346c51fd8 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:00.827704 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-361c95c9-31dd-4fdb-a2c7-804346c51fd8 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:00.828148 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-361c95c9-31dd-4fdb-a2c7-804346c51fd8 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:00.828817 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-361c95c9-31dd-4fdb-a2c7-804346c51fd8 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:00.835694 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-361c95c9-31dd-4fdb-a2c7-804346c51fd8 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:00.836654 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-361c95c9-31dd-4fdb-a2c7-804346c51fd8 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:01.020950 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-07aae52f-5c27-440c-ab16-708d89b0467d tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:01.021637 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-07aae52f-5c27-440c-ab16-708d89b0467d tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:01.033408 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07aae52f-5c27-440c-ab16-708d89b0467d tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:01.033903 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07aae52f-5c27-440c-ab16-708d89b0467d tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:01.034335 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07aae52f-5c27-440c-ab16-708d89b0467d tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:01.035050 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07aae52f-5c27-440c-ab16-708d89b0467d tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:01.035487 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07aae52f-5c27-440c-ab16-708d89b0467d tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:01.040182 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-07aae52f-5c27-440c-ab16-708d89b0467d tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:01.292066 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-361c95c9-31dd-4fdb-a2c7-804346c51fd8 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:01.295567 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=100 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:59:01.310756 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-361c95c9-31dd-4fdb-a2c7-804346c51fd8 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed" status: 200 len: 1370 microversion: 2.1 time: 0.506802 Sep 07 15:59:01.311689 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 215/443] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:00 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed => generated 1370 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:59:01.460667 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-07aae52f-5c27-440c-ab16-708d89b0467d tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:01.495111 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-07aae52f-5c27-440c-ab16-708d89b0467d tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1358 microversion: 2.1 time: 0.478513 Sep 07 15:59:01.511583 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 229/444] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:01 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1358 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:59:02.345090 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2814e2cf-f54c-46ed-a51c-f4ec6559de43 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:02.346360 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2814e2cf-f54c-46ed-a51c-f4ec6559de43 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:02.362088 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2814e2cf-f54c-46ed-a51c-f4ec6559de43 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:02.362751 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2814e2cf-f54c-46ed-a51c-f4ec6559de43 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:02.363262 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2814e2cf-f54c-46ed-a51c-f4ec6559de43 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:02.368055 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2814e2cf-f54c-46ed-a51c-f4ec6559de43 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:02.368055 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2814e2cf-f54c-46ed-a51c-f4ec6559de43 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:02.368055 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2814e2cf-f54c-46ed-a51c-f4ec6559de43 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:02.524580 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-77443e4b-621f-4365-86b9-9da87ae621c3 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:02.525394 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-77443e4b-621f-4365-86b9-9da87ae621c3 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:02.536944 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:59:02.536944 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=6 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:59:02.546213 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77443e4b-621f-4365-86b9-9da87ae621c3 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:02.546900 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77443e4b-621f-4365-86b9-9da87ae621c3 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:02.547500 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77443e4b-621f-4365-86b9-9da87ae621c3 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:02.548419 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77443e4b-621f-4365-86b9-9da87ae621c3 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:02.549024 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77443e4b-621f-4365-86b9-9da87ae621c3 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:02.549609 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77443e4b-621f-4365-86b9-9da87ae621c3 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:02.557806 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:59:02.721476 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-2814e2cf-f54c-46ed-a51c-f4ec6559de43 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:02.733256 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2814e2cf-f54c-46ed-a51c-f4ec6559de43 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed" status: 200 len: 1370 microversion: 2.1 time: 0.390433 Sep 07 15:59:02.738759 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 216/445] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:02 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed => generated 1370 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:59:02.853728 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-77443e4b-621f-4365-86b9-9da87ae621c3 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:02.875512 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-77443e4b-621f-4365-86b9-9da87ae621c3 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1358 microversion: 2.1 time: 0.355787 Sep 07 15:59:02.876538 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 230/446] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:02 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1358 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:59:03.758099 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-792ec784-66f2-4491-9b64-f4a7e76777a6 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:03.758876 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-792ec784-66f2-4491-9b64-f4a7e76777a6 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:03.765705 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-792ec784-66f2-4491-9b64-f4a7e76777a6 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:03.766528 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-792ec784-66f2-4491-9b64-f4a7e76777a6 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:03.767734 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-792ec784-66f2-4491-9b64-f4a7e76777a6 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:03.770990 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-792ec784-66f2-4491-9b64-f4a7e76777a6 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:03.771689 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-792ec784-66f2-4491-9b64-f4a7e76777a6 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:03.772353 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-792ec784-66f2-4491-9b64-f4a7e76777a6 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:03.899017 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ee7c5e9d-e434-490a-b6f5-59e887a0293d tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:03.900516 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ee7c5e9d-e434-490a-b6f5-59e887a0293d tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:03.909033 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ee7c5e9d-e434-490a-b6f5-59e887a0293d tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:03.910187 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ee7c5e9d-e434-490a-b6f5-59e887a0293d tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:03.910864 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ee7c5e9d-e434-490a-b6f5-59e887a0293d tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:03.912043 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ee7c5e9d-e434-490a-b6f5-59e887a0293d tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:03.912738 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ee7c5e9d-e434-490a-b6f5-59e887a0293d tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:03.913377 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ee7c5e9d-e434-490a-b6f5-59e887a0293d tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:03.960334 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-792ec784-66f2-4491-9b64-f4a7e76777a6 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:03.972341 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-792ec784-66f2-4491-9b64-f4a7e76777a6 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed" status: 200 len: 1370 microversion: 2.1 time: 0.218084 Sep 07 15:59:03.973460 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 217/447] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:03 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed => generated 1370 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:59:04.131848 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ee7c5e9d-e434-490a-b6f5-59e887a0293d tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:04.156385 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ee7c5e9d-e434-490a-b6f5-59e887a0293d tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1358 microversion: 2.1 time: 0.261537 Sep 07 15:59:04.160066 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 231/448] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:03 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1358 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:59:04.832982 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-982e0aa4-41ad-4c1a-adca-137e083c00f9 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1730680086", "imageRef": "cfe19284-9779-46f4-b458-81d5475ec82f", "flavorRef": "452", "networks": [{"uuid": "525b0cd3-f585-4458-95a2-096aacadb034"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:59:04.997590 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9e9ccc0a-c4c6-479d-b292-c4b598d2db8d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:04.998914 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9e9ccc0a-c4c6-479d-b292-c4b598d2db8d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:05.007093 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e9ccc0a-c4c6-479d-b292-c4b598d2db8d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:05.012624 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e9ccc0a-c4c6-479d-b292-c4b598d2db8d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:05.013369 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e9ccc0a-c4c6-479d-b292-c4b598d2db8d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:05.014298 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e9ccc0a-c4c6-479d-b292-c4b598d2db8d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:05.014925 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e9ccc0a-c4c6-479d-b292-c4b598d2db8d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:05.015513 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e9ccc0a-c4c6-479d-b292-c4b598d2db8d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:05.218917 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9e9ccc0a-c4c6-479d-b292-c4b598d2db8d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:05.228647 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9e9ccc0a-c4c6-479d-b292-c4b598d2db8d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed" status: 200 len: 1370 microversion: 2.1 time: 0.235197 Sep 07 15:59:05.239461 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 232/449] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:04 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed => generated 1370 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:59:05.239461 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-25ea2c5f-d759-4264-8eb2-17e54be32ab0 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:05.239461 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-25ea2c5f-d759-4264-8eb2-17e54be32ab0 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:05.246177 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25ea2c5f-d759-4264-8eb2-17e54be32ab0 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:05.246177 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25ea2c5f-d759-4264-8eb2-17e54be32ab0 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:05.246177 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25ea2c5f-d759-4264-8eb2-17e54be32ab0 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:05.246177 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25ea2c5f-d759-4264-8eb2-17e54be32ab0 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:05.246601 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25ea2c5f-d759-4264-8eb2-17e54be32ab0 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:05.246601 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-25ea2c5f-d759-4264-8eb2-17e54be32ab0 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:05.443628 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-25ea2c5f-d759-4264-8eb2-17e54be32ab0 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:05.453147 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-25ea2c5f-d759-4264-8eb2-17e54be32ab0 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1358 microversion: 2.1 time: 0.221899 Sep 07 15:59:05.454332 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 233/450] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:05 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1358 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:59:06.253958 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-81f6f2dd-17d6-4bf5-aa4b-a8e3b524b11d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:06.254862 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-81f6f2dd-17d6-4bf5-aa4b-a8e3b524b11d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:06.271158 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-81f6f2dd-17d6-4bf5-aa4b-a8e3b524b11d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:06.271675 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-81f6f2dd-17d6-4bf5-aa4b-a8e3b524b11d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:06.272111 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-81f6f2dd-17d6-4bf5-aa4b-a8e3b524b11d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:06.272814 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-81f6f2dd-17d6-4bf5-aa4b-a8e3b524b11d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:06.273294 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-81f6f2dd-17d6-4bf5-aa4b-a8e3b524b11d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:06.273720 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-81f6f2dd-17d6-4bf5-aa4b-a8e3b524b11d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:06.420321 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-81f6f2dd-17d6-4bf5-aa4b-a8e3b524b11d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:06.428331 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-81f6f2dd-17d6-4bf5-aa4b-a8e3b524b11d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed" status: 200 len: 1370 microversion: 2.1 time: 0.178122 Sep 07 15:59:06.430405 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 234/451] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:06 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed => generated 1370 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:59:06.484538 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d23dbcd8-75c4-4955-a950-7dbaa2680177 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:06.485690 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d23dbcd8-75c4-4955-a950-7dbaa2680177 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:06.492359 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d23dbcd8-75c4-4955-a950-7dbaa2680177 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:06.492911 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d23dbcd8-75c4-4955-a950-7dbaa2680177 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:06.493417 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d23dbcd8-75c4-4955-a950-7dbaa2680177 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:06.494185 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d23dbcd8-75c4-4955-a950-7dbaa2680177 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:06.494879 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d23dbcd8-75c4-4955-a950-7dbaa2680177 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:06.495503 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d23dbcd8-75c4-4955-a950-7dbaa2680177 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:06.695906 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d23dbcd8-75c4-4955-a950-7dbaa2680177 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:06.705369 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d23dbcd8-75c4-4955-a950-7dbaa2680177 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1358 microversion: 2.1 time: 0.225093 Sep 07 15:59:06.706153 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 235/452] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:06 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1358 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:59:06.962831 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-982e0aa4-41ad-4c1a-adca-137e083c00f9 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] validate_networks() for [('525b0cd3-f585-4458-95a2-096aacadb034', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 15:59:07.349881 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-982e0aa4-41ad-4c1a-adca-137e083c00f9 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 15:59:07.350303 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-982e0aa4-41ad-4c1a-adca-137e083c00f9 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 15:59:07.351065 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-982e0aa4-41ad-4c1a-adca-137e083c00f9 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 15:59:07.351471 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-982e0aa4-41ad-4c1a-adca-137e083c00f9 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 15:59:07.351955 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-982e0aa4-41ad-4c1a-adca-137e083c00f9 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 15:59:07.360714 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-982e0aa4-41ad-4c1a-adca-137e083c00f9 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:07.361205 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-982e0aa4-41ad-4c1a-adca-137e083c00f9 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:07.361642 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-982e0aa4-41ad-4c1a-adca-137e083c00f9 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:07.362369 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-982e0aa4-41ad-4c1a-adca-137e083c00f9 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:07.362826 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-982e0aa4-41ad-4c1a-adca-137e083c00f9 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:07.363254 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-982e0aa4-41ad-4c1a-adca-137e083c00f9 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:07.380393 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.quota [None req-982e0aa4-41ad-4c1a-adca-137e083c00f9 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Getting quotas for project 8213db22feb041c196d02aaeac22d875. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 15:59:07.384349 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.quota [None req-982e0aa4-41ad-4c1a-adca-137e083c00f9 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Getting quotas for user c2e9cc0ef8394696b127a32edd75e885 and project 8213db22feb041c196d02aaeac22d875. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 15:59:07.396464 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-982e0aa4-41ad-4c1a-adca-137e083c00f9 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 15:59:07.398750 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-982e0aa4-41ad-4c1a-adca-137e083c00f9 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 7807823a-6888-4edf-90cf-3f72de9017c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cfe19284-9779-46f4-b458-81d5475ec82f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 15:59:07.454419 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ebe0bb02-b7d9-4ee9-b306-d7ed20bcc33f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:07.455124 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ebe0bb02-b7d9-4ee9-b306-d7ed20bcc33f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:07.458088 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-982e0aa4-41ad-4c1a-adca-137e083c00f9 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.629657 Sep 07 15:59:07.464889 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 218/453] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Sep 7 15:59:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 15:59:07.467122 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ebe0bb02-b7d9-4ee9-b306-d7ed20bcc33f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:07.467750 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ebe0bb02-b7d9-4ee9-b306-d7ed20bcc33f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:07.471526 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-114397b4-720e-48f4-888a-3d6ba5590323 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:07.471526 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-114397b4-720e-48f4-888a-3d6ba5590323 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 7807823a-6888-4edf-90cf-3f72de9017c7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:07.472595 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ebe0bb02-b7d9-4ee9-b306-d7ed20bcc33f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:07.472775 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ebe0bb02-b7d9-4ee9-b306-d7ed20bcc33f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:07.473305 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ebe0bb02-b7d9-4ee9-b306-d7ed20bcc33f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:07.473870 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ebe0bb02-b7d9-4ee9-b306-d7ed20bcc33f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:07.557868 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-114397b4-720e-48f4-888a-3d6ba5590323 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e9cc0ef8394696b127a32edd75e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8213db22feb041c196d02aaeac22d875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:07.567820 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-114397b4-720e-48f4-888a-3d6ba5590323 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7" status: 200 len: 1219 microversion: 2.1 time: 0.101728 Sep 07 15:59:07.568387 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 219/454] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:07 2022] GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7 => generated 1219 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:59:07.649150 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ebe0bb02-b7d9-4ee9-b306-d7ed20bcc33f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:07.656954 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ebe0bb02-b7d9-4ee9-b306-d7ed20bcc33f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed" status: 200 len: 1370 microversion: 2.1 time: 0.207036 Sep 07 15:59:07.657515 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 236/455] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:07 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed => generated 1370 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:59:07.728964 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6f018553-26e2-460c-8a67-5ed6559c9ced tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:07.729577 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6f018553-26e2-460c-8a67-5ed6559c9ced tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:07.736220 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f018553-26e2-460c-8a67-5ed6559c9ced tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:07.736664 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f018553-26e2-460c-8a67-5ed6559c9ced tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:07.737106 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f018553-26e2-460c-8a67-5ed6559c9ced tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:07.737818 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f018553-26e2-460c-8a67-5ed6559c9ced tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:07.738263 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f018553-26e2-460c-8a67-5ed6559c9ced tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:07.738708 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6f018553-26e2-460c-8a67-5ed6559c9ced tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:07.883467 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-6f018553-26e2-460c-8a67-5ed6559c9ced tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:07.892650 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6f018553-26e2-460c-8a67-5ed6559c9ced tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1358 microversion: 2.1 time: 0.167673 Sep 07 15:59:07.894304 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 220/456] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:07 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:59:08.589599 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-908c5a83-6e4f-41ee-8a22-16b971855cb1 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:08.591020 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-908c5a83-6e4f-41ee-8a22-16b971855cb1 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 7807823a-6888-4edf-90cf-3f72de9017c7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:08.599964 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-908c5a83-6e4f-41ee-8a22-16b971855cb1 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:08.600699 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-908c5a83-6e4f-41ee-8a22-16b971855cb1 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:08.601126 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-908c5a83-6e4f-41ee-8a22-16b971855cb1 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:08.601807 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-908c5a83-6e4f-41ee-8a22-16b971855cb1 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:08.602251 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-908c5a83-6e4f-41ee-8a22-16b971855cb1 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:08.602666 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-908c5a83-6e4f-41ee-8a22-16b971855cb1 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:08.672219 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-908c5a83-6e4f-41ee-8a22-16b971855cb1 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e9cc0ef8394696b127a32edd75e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8213db22feb041c196d02aaeac22d875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:08.681367 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-908c5a83-6e4f-41ee-8a22-16b971855cb1 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7" status: 200 len: 1223 microversion: 2.1 time: 0.095507 Sep 07 15:59:08.681927 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 237/457] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:08 2022] GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7 => generated 1223 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:59:08.682373 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6ae300a2-6d1f-4f56-bab2-f053f89b01dc tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:08.683720 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6ae300a2-6d1f-4f56-bab2-f053f89b01dc tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:08.690415 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ae300a2-6d1f-4f56-bab2-f053f89b01dc tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:08.690897 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ae300a2-6d1f-4f56-bab2-f053f89b01dc tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:08.691335 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ae300a2-6d1f-4f56-bab2-f053f89b01dc tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:08.692063 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ae300a2-6d1f-4f56-bab2-f053f89b01dc tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:08.692518 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ae300a2-6d1f-4f56-bab2-f053f89b01dc tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:08.692940 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ae300a2-6d1f-4f56-bab2-f053f89b01dc tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:08.855701 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-6ae300a2-6d1f-4f56-bab2-f053f89b01dc tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:08.864409 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6ae300a2-6d1f-4f56-bab2-f053f89b01dc tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed" status: 200 len: 1370 microversion: 2.1 time: 0.186616 Sep 07 15:59:08.865015 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 221/458] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:08 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed => generated 1370 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:59:08.916743 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f0a89142-402c-411c-a9c6-7cdb6de18493 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:08.917667 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f0a89142-402c-411c-a9c6-7cdb6de18493 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:08.924574 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0a89142-402c-411c-a9c6-7cdb6de18493 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:08.925048 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0a89142-402c-411c-a9c6-7cdb6de18493 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:08.925472 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0a89142-402c-411c-a9c6-7cdb6de18493 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:08.926144 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0a89142-402c-411c-a9c6-7cdb6de18493 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:08.926589 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0a89142-402c-411c-a9c6-7cdb6de18493 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:08.927004 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0a89142-402c-411c-a9c6-7cdb6de18493 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:09.068127 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f0a89142-402c-411c-a9c6-7cdb6de18493 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:09.076581 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f0a89142-402c-411c-a9c6-7cdb6de18493 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1358 microversion: 2.1 time: 0.164335 Sep 07 15:59:09.077255 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 238/459] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:08 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:59:09.705111 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-61eef12c-85f7-49b6-8a79-ccf3f51e3e24 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:09.705721 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-61eef12c-85f7-49b6-8a79-ccf3f51e3e24 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 7807823a-6888-4edf-90cf-3f72de9017c7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:09.712475 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-61eef12c-85f7-49b6-8a79-ccf3f51e3e24 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:09.712954 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-61eef12c-85f7-49b6-8a79-ccf3f51e3e24 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:09.713385 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-61eef12c-85f7-49b6-8a79-ccf3f51e3e24 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:09.714068 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-61eef12c-85f7-49b6-8a79-ccf3f51e3e24 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:09.714519 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-61eef12c-85f7-49b6-8a79-ccf3f51e3e24 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:09.714939 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-61eef12c-85f7-49b6-8a79-ccf3f51e3e24 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:09.782110 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-61eef12c-85f7-49b6-8a79-ccf3f51e3e24 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e9cc0ef8394696b127a32edd75e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8213db22feb041c196d02aaeac22d875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:09.789678 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-61eef12c-85f7-49b6-8a79-ccf3f51e3e24 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7" status: 200 len: 1223 microversion: 2.1 time: 0.088627 Sep 07 15:59:09.790231 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 222/460] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:09 2022] GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7 => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:59:09.890988 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-223c9fb9-a325-405d-b541-529617c5493f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:09.891753 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-223c9fb9-a325-405d-b541-529617c5493f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:09.897649 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-223c9fb9-a325-405d-b541-529617c5493f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:09.898202 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-223c9fb9-a325-405d-b541-529617c5493f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:09.898632 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-223c9fb9-a325-405d-b541-529617c5493f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:09.899314 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-223c9fb9-a325-405d-b541-529617c5493f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:09.899781 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-223c9fb9-a325-405d-b541-529617c5493f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:09.900198 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-223c9fb9-a325-405d-b541-529617c5493f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:10.102479 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-75e7d766-a377-48c8-8de0-e5d8422ed1ef tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:10.103090 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-75e7d766-a377-48c8-8de0-e5d8422ed1ef tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:10.109809 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-75e7d766-a377-48c8-8de0-e5d8422ed1ef tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:10.110628 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-75e7d766-a377-48c8-8de0-e5d8422ed1ef tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:10.111057 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-75e7d766-a377-48c8-8de0-e5d8422ed1ef tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:10.111806 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-75e7d766-a377-48c8-8de0-e5d8422ed1ef tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:10.112255 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-75e7d766-a377-48c8-8de0-e5d8422ed1ef tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:10.112666 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-75e7d766-a377-48c8-8de0-e5d8422ed1ef tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:10.152716 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-223c9fb9-a325-405d-b541-529617c5493f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:10.167113 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-223c9fb9-a325-405d-b541-529617c5493f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed" status: 200 len: 1370 microversion: 2.1 time: 0.281492 Sep 07 15:59:10.167809 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 239/461] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:09 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed => generated 1370 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:59:10.283643 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-75e7d766-a377-48c8-8de0-e5d8422ed1ef tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:10.301920 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-75e7d766-a377-48c8-8de0-e5d8422ed1ef tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1358 microversion: 2.1 time: 0.203425 Sep 07 15:59:10.302504 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 223/462] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:10 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1358 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:59:10.814142 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c5a2a95e-89e3-4251-b91f-5cba8b65bddb tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:10.814890 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c5a2a95e-89e3-4251-b91f-5cba8b65bddb tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 7807823a-6888-4edf-90cf-3f72de9017c7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:10.822763 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c5a2a95e-89e3-4251-b91f-5cba8b65bddb tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:10.823445 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c5a2a95e-89e3-4251-b91f-5cba8b65bddb tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:10.824061 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c5a2a95e-89e3-4251-b91f-5cba8b65bddb tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:10.825036 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c5a2a95e-89e3-4251-b91f-5cba8b65bddb tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:10.825663 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c5a2a95e-89e3-4251-b91f-5cba8b65bddb tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:10.826087 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c5a2a95e-89e3-4251-b91f-5cba8b65bddb tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:10.865099 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:59:10.929928 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c5a2a95e-89e3-4251-b91f-5cba8b65bddb tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e9cc0ef8394696b127a32edd75e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8213db22feb041c196d02aaeac22d875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:10.939992 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c5a2a95e-89e3-4251-b91f-5cba8b65bddb tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7" status: 200 len: 1223 microversion: 2.1 time: 0.128648 Sep 07 15:59:10.941721 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 240/463] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:10 2022] GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7 => generated 1223 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:59:11.192370 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b1a7a945-fb5a-4af1-b56e-cbd466509e4e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:11.193599 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b1a7a945-fb5a-4af1-b56e-cbd466509e4e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:11.201030 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b1a7a945-fb5a-4af1-b56e-cbd466509e4e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:11.201704 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b1a7a945-fb5a-4af1-b56e-cbd466509e4e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:11.202328 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b1a7a945-fb5a-4af1-b56e-cbd466509e4e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:11.203213 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b1a7a945-fb5a-4af1-b56e-cbd466509e4e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:11.203857 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b1a7a945-fb5a-4af1-b56e-cbd466509e4e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:11.204439 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b1a7a945-fb5a-4af1-b56e-cbd466509e4e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:11.326816 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a5bb5ebb-419f-4e7e-a78a-a22cfba23192 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:11.327710 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a5bb5ebb-419f-4e7e-a78a-a22cfba23192 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:11.334440 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5bb5ebb-419f-4e7e-a78a-a22cfba23192 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:11.335036 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5bb5ebb-419f-4e7e-a78a-a22cfba23192 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:11.335636 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5bb5ebb-419f-4e7e-a78a-a22cfba23192 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:11.336449 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5bb5ebb-419f-4e7e-a78a-a22cfba23192 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:11.336961 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5bb5ebb-419f-4e7e-a78a-a22cfba23192 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:11.337610 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a5bb5ebb-419f-4e7e-a78a-a22cfba23192 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:11.357685 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-b1a7a945-fb5a-4af1-b56e-cbd466509e4e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:11.365634 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b1a7a945-fb5a-4af1-b56e-cbd466509e4e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed" status: 200 len: 1370 microversion: 2.1 time: 0.178656 Sep 07 15:59:11.366190 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 224/464] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:11 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed => generated 1370 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:59:11.488844 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a5bb5ebb-419f-4e7e-a78a-a22cfba23192 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:11.497374 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a5bb5ebb-419f-4e7e-a78a-a22cfba23192 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1358 microversion: 2.1 time: 0.174352 Sep 07 15:59:11.497968 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 241/465] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:11 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:59:11.963860 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b3275030-1845-409a-b7a1-a63d9c0f00e0 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:11.964490 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b3275030-1845-409a-b7a1-a63d9c0f00e0 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 7807823a-6888-4edf-90cf-3f72de9017c7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:11.970945 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b3275030-1845-409a-b7a1-a63d9c0f00e0 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:11.971424 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b3275030-1845-409a-b7a1-a63d9c0f00e0 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:11.971885 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b3275030-1845-409a-b7a1-a63d9c0f00e0 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:11.972590 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b3275030-1845-409a-b7a1-a63d9c0f00e0 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:11.973036 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b3275030-1845-409a-b7a1-a63d9c0f00e0 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:11.973451 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b3275030-1845-409a-b7a1-a63d9c0f00e0 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:12.036362 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-b3275030-1845-409a-b7a1-a63d9c0f00e0 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e9cc0ef8394696b127a32edd75e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8213db22feb041c196d02aaeac22d875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:12.044518 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b3275030-1845-409a-b7a1-a63d9c0f00e0 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7" status: 200 len: 1223 microversion: 2.1 time: 0.084815 Sep 07 15:59:12.045087 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 225/466] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:11 2022] GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7 => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:59:12.390027 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-77816d2b-705d-4e71-a394-e5847e190498 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:12.390583 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-77816d2b-705d-4e71-a394-e5847e190498 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:12.396428 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77816d2b-705d-4e71-a394-e5847e190498 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:12.396897 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77816d2b-705d-4e71-a394-e5847e190498 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:12.397326 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77816d2b-705d-4e71-a394-e5847e190498 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:12.397997 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77816d2b-705d-4e71-a394-e5847e190498 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:12.398446 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77816d2b-705d-4e71-a394-e5847e190498 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:12.398861 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-77816d2b-705d-4e71-a394-e5847e190498 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:12.521123 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e05a1c25-00ab-4d26-886e-b7f2d5f0cb2f tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:12.521871 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e05a1c25-00ab-4d26-886e-b7f2d5f0cb2f tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:12.525914 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-77816d2b-705d-4e71-a394-e5847e190498 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:12.528289 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e05a1c25-00ab-4d26-886e-b7f2d5f0cb2f tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:12.528769 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e05a1c25-00ab-4d26-886e-b7f2d5f0cb2f tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:12.529202 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e05a1c25-00ab-4d26-886e-b7f2d5f0cb2f tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:12.529887 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e05a1c25-00ab-4d26-886e-b7f2d5f0cb2f tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:12.530362 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e05a1c25-00ab-4d26-886e-b7f2d5f0cb2f tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:12.530782 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e05a1c25-00ab-4d26-886e-b7f2d5f0cb2f tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:12.533708 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-77816d2b-705d-4e71-a394-e5847e190498 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed" status: 200 len: 1370 microversion: 2.1 time: 0.148206 Sep 07 15:59:12.534260 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 242/467] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:12 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed => generated 1370 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:59:12.656029 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-e05a1c25-00ab-4d26-886e-b7f2d5f0cb2f tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:12.663537 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e05a1c25-00ab-4d26-886e-b7f2d5f0cb2f tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1358 microversion: 2.1 time: 0.146369 Sep 07 15:59:12.664106 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 226/468] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:12 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:59:13.067437 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c29fe791-8913-476b-b6a8-b6aab6eea9a7 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:13.068328 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c29fe791-8913-476b-b6a8-b6aab6eea9a7 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 7807823a-6888-4edf-90cf-3f72de9017c7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:13.074580 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c29fe791-8913-476b-b6a8-b6aab6eea9a7 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:13.075102 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c29fe791-8913-476b-b6a8-b6aab6eea9a7 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:13.075535 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c29fe791-8913-476b-b6a8-b6aab6eea9a7 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:13.076279 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c29fe791-8913-476b-b6a8-b6aab6eea9a7 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:13.077727 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c29fe791-8913-476b-b6a8-b6aab6eea9a7 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:13.077727 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c29fe791-8913-476b-b6a8-b6aab6eea9a7 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:13.139532 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c29fe791-8913-476b-b6a8-b6aab6eea9a7 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e9cc0ef8394696b127a32edd75e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8213db22feb041c196d02aaeac22d875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:13.147869 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c29fe791-8913-476b-b6a8-b6aab6eea9a7 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7" status: 200 len: 1223 microversion: 2.1 time: 0.084145 Sep 07 15:59:13.148231 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 243/469] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:13 2022] GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:59:13.556696 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-77b972ed-27b9-4d05-9324-d0a0fa477d24 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:13.557301 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-77b972ed-27b9-4d05-9324-d0a0fa477d24 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:13.563681 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-77b972ed-27b9-4d05-9324-d0a0fa477d24 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:13.564191 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-77b972ed-27b9-4d05-9324-d0a0fa477d24 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:13.564626 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-77b972ed-27b9-4d05-9324-d0a0fa477d24 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:13.565308 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-77b972ed-27b9-4d05-9324-d0a0fa477d24 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:13.565768 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-77b972ed-27b9-4d05-9324-d0a0fa477d24 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:13.566188 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-77b972ed-27b9-4d05-9324-d0a0fa477d24 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:13.686136 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7ca57d43-d99a-4c98-993b-06c1219ba5a0 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:13.686852 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7ca57d43-d99a-4c98-993b-06c1219ba5a0 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:13.692738 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ca57d43-d99a-4c98-993b-06c1219ba5a0 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:13.693222 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ca57d43-d99a-4c98-993b-06c1219ba5a0 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:13.693658 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ca57d43-d99a-4c98-993b-06c1219ba5a0 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:13.694348 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ca57d43-d99a-4c98-993b-06c1219ba5a0 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:13.694799 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ca57d43-d99a-4c98-993b-06c1219ba5a0 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:13.695222 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ca57d43-d99a-4c98-993b-06c1219ba5a0 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:13.696819 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-77b972ed-27b9-4d05-9324-d0a0fa477d24 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:13.704953 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-77b972ed-27b9-4d05-9324-d0a0fa477d24 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed" status: 200 len: 1370 microversion: 2.1 time: 0.152219 Sep 07 15:59:13.705515 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 227/470] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:13 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:59:13.821250 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7ca57d43-d99a-4c98-993b-06c1219ba5a0 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:13.829546 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7ca57d43-d99a-4c98-993b-06c1219ba5a0 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1358 microversion: 2.1 time: 0.147257 Sep 07 15:59:13.830108 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 244/471] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:13 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:59:14.171496 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-63ac9ed5-ce58-459b-a4c4-dc0c77bb9b3e tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:14.172126 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-63ac9ed5-ce58-459b-a4c4-dc0c77bb9b3e tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 7807823a-6888-4edf-90cf-3f72de9017c7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:14.178229 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63ac9ed5-ce58-459b-a4c4-dc0c77bb9b3e tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:14.178708 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63ac9ed5-ce58-459b-a4c4-dc0c77bb9b3e tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:14.179141 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63ac9ed5-ce58-459b-a4c4-dc0c77bb9b3e tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:14.179843 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63ac9ed5-ce58-459b-a4c4-dc0c77bb9b3e tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:14.180296 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63ac9ed5-ce58-459b-a4c4-dc0c77bb9b3e tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:14.180716 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63ac9ed5-ce58-459b-a4c4-dc0c77bb9b3e tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:14.242462 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-63ac9ed5-ce58-459b-a4c4-dc0c77bb9b3e tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e9cc0ef8394696b127a32edd75e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8213db22feb041c196d02aaeac22d875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:14.250229 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-63ac9ed5-ce58-459b-a4c4-dc0c77bb9b3e tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7" status: 200 len: 1223 microversion: 2.1 time: 0.083297 Sep 07 15:59:14.250776 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 228/472] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:14 2022] GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:59:14.728504 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f361d2cf-06a6-4d17-b435-96a9a0bf9ecf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:14.729105 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f361d2cf-06a6-4d17-b435-96a9a0bf9ecf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:14.735104 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f361d2cf-06a6-4d17-b435-96a9a0bf9ecf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:14.735590 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f361d2cf-06a6-4d17-b435-96a9a0bf9ecf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:14.736120 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f361d2cf-06a6-4d17-b435-96a9a0bf9ecf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:14.736803 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f361d2cf-06a6-4d17-b435-96a9a0bf9ecf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:14.737249 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f361d2cf-06a6-4d17-b435-96a9a0bf9ecf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:14.737670 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f361d2cf-06a6-4d17-b435-96a9a0bf9ecf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:14.853026 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fe4a72e9-f735-4ae1-9eaf-6c9c363dbe2f tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:14.853631 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fe4a72e9-f735-4ae1-9eaf-6c9c363dbe2f tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:14.860387 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fe4a72e9-f735-4ae1-9eaf-6c9c363dbe2f tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:14.860864 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fe4a72e9-f735-4ae1-9eaf-6c9c363dbe2f tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:14.861289 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fe4a72e9-f735-4ae1-9eaf-6c9c363dbe2f tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:14.861967 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fe4a72e9-f735-4ae1-9eaf-6c9c363dbe2f tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:14.862415 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fe4a72e9-f735-4ae1-9eaf-6c9c363dbe2f tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:14.862827 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fe4a72e9-f735-4ae1-9eaf-6c9c363dbe2f tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:14.869094 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f361d2cf-06a6-4d17-b435-96a9a0bf9ecf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:14.877356 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f361d2cf-06a6-4d17-b435-96a9a0bf9ecf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed" status: 200 len: 1370 microversion: 2.1 time: 0.152875 Sep 07 15:59:14.878005 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 245/473] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:14 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:59:14.987320 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-fe4a72e9-f735-4ae1-9eaf-6c9c363dbe2f tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:14.994790 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fe4a72e9-f735-4ae1-9eaf-6c9c363dbe2f tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1358 microversion: 2.1 time: 0.145854 Sep 07 15:59:14.995347 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 229/474] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:14 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:59:15.274912 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4d4c9a43-b6bc-4117-aaff-98d005047041 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:15.275763 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4d4c9a43-b6bc-4117-aaff-98d005047041 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 7807823a-6888-4edf-90cf-3f72de9017c7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:15.284115 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d4c9a43-b6bc-4117-aaff-98d005047041 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:15.284718 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d4c9a43-b6bc-4117-aaff-98d005047041 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:15.285220 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d4c9a43-b6bc-4117-aaff-98d005047041 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:15.286161 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d4c9a43-b6bc-4117-aaff-98d005047041 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:15.286705 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d4c9a43-b6bc-4117-aaff-98d005047041 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:15.287267 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d4c9a43-b6bc-4117-aaff-98d005047041 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:15.395454 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-4d4c9a43-b6bc-4117-aaff-98d005047041 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e9cc0ef8394696b127a32edd75e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8213db22feb041c196d02aaeac22d875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:15.405490 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4d4c9a43-b6bc-4117-aaff-98d005047041 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7" status: 200 len: 1223 microversion: 2.1 time: 0.135236 Sep 07 15:59:15.406309 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 246/475] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:15 2022] GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7 => generated 1223 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:59:15.894450 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-014b5e0a-4743-40e6-b9a6-e87e9614c58d req-f201eb42-f8f2-4a66-8c17-f1577517855b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84743d24-2644-46a9-86a3-030706f2ec33", "tag": "62d356d3-a43c-486d-a45b-1855b53e8a1d"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:59:15.901083 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-852c5471-c111-4f84-b9e8-0dbb57ac5169 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:15.904001 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-852c5471-c111-4f84-b9e8-0dbb57ac5169 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:15.908798 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-014b5e0a-4743-40e6-b9a6-e87e9614c58d req-f201eb42-f8f2-4a66-8c17-f1577517855b service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:15.909422 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-014b5e0a-4743-40e6-b9a6-e87e9614c58d req-f201eb42-f8f2-4a66-8c17-f1577517855b service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:15.909945 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-014b5e0a-4743-40e6-b9a6-e87e9614c58d req-f201eb42-f8f2-4a66-8c17-f1577517855b service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:15.914647 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-852c5471-c111-4f84-b9e8-0dbb57ac5169 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:15.915123 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-852c5471-c111-4f84-b9e8-0dbb57ac5169 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:15.915593 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-852c5471-c111-4f84-b9e8-0dbb57ac5169 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:15.917207 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-852c5471-c111-4f84-b9e8-0dbb57ac5169 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:15.917679 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-852c5471-c111-4f84-b9e8-0dbb57ac5169 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:15.918113 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-852c5471-c111-4f84-b9e8-0dbb57ac5169 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:15.930324 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-014b5e0a-4743-40e6-b9a6-e87e9614c58d req-f201eb42-f8f2-4a66-8c17-f1577517855b service nova] Creating event network-changed:62d356d3-a43c-486d-a45b-1855b53e8a1d for instance 84743d24-2644-46a9-86a3-030706f2ec33 on hv-cinder-85331 Sep 07 15:59:15.936941 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-014b5e0a-4743-40e6-b9a6-e87e9614c58d req-f201eb42-f8f2-4a66-8c17-f1577517855b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045836 Sep 07 15:59:15.938284 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 230/476] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 15:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 15:59:16.019074 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d728a28e-e357-4d9b-8926-2328709f05c3 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:16.019821 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d728a28e-e357-4d9b-8926-2328709f05c3 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:16.026041 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d728a28e-e357-4d9b-8926-2328709f05c3 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:16.026530 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d728a28e-e357-4d9b-8926-2328709f05c3 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:16.026963 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d728a28e-e357-4d9b-8926-2328709f05c3 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:16.027733 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d728a28e-e357-4d9b-8926-2328709f05c3 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:16.028706 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d728a28e-e357-4d9b-8926-2328709f05c3 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:16.029127 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d728a28e-e357-4d9b-8926-2328709f05c3 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:16.057716 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-852c5471-c111-4f84-b9e8-0dbb57ac5169 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:16.065337 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-852c5471-c111-4f84-b9e8-0dbb57ac5169 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed" status: 200 len: 1370 microversion: 2.1 time: 0.168602 Sep 07 15:59:16.065894 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 247/477] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:15 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed => generated 1370 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:59:16.163195 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-d728a28e-e357-4d9b-8926-2328709f05c3 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:16.186604 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d728a28e-e357-4d9b-8926-2328709f05c3 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1358 microversion: 2.1 time: 0.171625 Sep 07 15:59:16.187488 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 231/478] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:16 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:59:16.427853 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4f31ffe6-ab44-4589-84a6-3419713d2671 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:16.428459 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4f31ffe6-ab44-4589-84a6-3419713d2671 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 7807823a-6888-4edf-90cf-3f72de9017c7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:16.435015 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f31ffe6-ab44-4589-84a6-3419713d2671 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:16.435524 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f31ffe6-ab44-4589-84a6-3419713d2671 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:16.435979 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f31ffe6-ab44-4589-84a6-3419713d2671 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:16.436706 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f31ffe6-ab44-4589-84a6-3419713d2671 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:16.437151 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f31ffe6-ab44-4589-84a6-3419713d2671 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:16.437569 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f31ffe6-ab44-4589-84a6-3419713d2671 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:16.499806 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-4f31ffe6-ab44-4589-84a6-3419713d2671 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e9cc0ef8394696b127a32edd75e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8213db22feb041c196d02aaeac22d875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:16.507581 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4f31ffe6-ab44-4589-84a6-3419713d2671 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7" status: 200 len: 1271 microversion: 2.1 time: 0.083645 Sep 07 15:59:16.508141 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 248/479] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:16 2022] GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7 => generated 1271 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:59:16.580863 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0023cb03-c436-4bab-b7c4-f1de9194a426 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:16.581278 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0023cb03-c436-4bab-b7c4-f1de9194a426 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:16.587198 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0023cb03-c436-4bab-b7c4-f1de9194a426 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:16.587713 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0023cb03-c436-4bab-b7c4-f1de9194a426 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:16.588139 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0023cb03-c436-4bab-b7c4-f1de9194a426 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:16.588843 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0023cb03-c436-4bab-b7c4-f1de9194a426 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:16.589292 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0023cb03-c436-4bab-b7c4-f1de9194a426 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:16.589707 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0023cb03-c436-4bab-b7c4-f1de9194a426 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:16.613195 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0023cb03-c436-4bab-b7c4-f1de9194a426 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a/ips" status: 200 len: 151 microversion: 2.20 time: 0.036251 Sep 07 15:59:16.613760 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 232/480] 10.222.0.17 () {60 vars in 1289 bytes} [Wed Sep 7 15:59:16 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 15:59:17.089628 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f36632be-2cb6-4858-925c-4f1cf3f67c8d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:17.090853 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f36632be-2cb6-4858-925c-4f1cf3f67c8d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:17.102240 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f36632be-2cb6-4858-925c-4f1cf3f67c8d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:17.106935 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f36632be-2cb6-4858-925c-4f1cf3f67c8d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:17.108941 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f36632be-2cb6-4858-925c-4f1cf3f67c8d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:17.111400 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f36632be-2cb6-4858-925c-4f1cf3f67c8d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:17.112878 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f36632be-2cb6-4858-925c-4f1cf3f67c8d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:17.113774 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f36632be-2cb6-4858-925c-4f1cf3f67c8d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:17.214651 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fd6dc9b0-79e0-48ad-b9f7-4cd6c58c51b1 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:17.216285 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fd6dc9b0-79e0-48ad-b9f7-4cd6c58c51b1 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:17.224132 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd6dc9b0-79e0-48ad-b9f7-4cd6c58c51b1 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:17.224938 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd6dc9b0-79e0-48ad-b9f7-4cd6c58c51b1 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:17.226374 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd6dc9b0-79e0-48ad-b9f7-4cd6c58c51b1 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:17.227625 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd6dc9b0-79e0-48ad-b9f7-4cd6c58c51b1 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:17.228240 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd6dc9b0-79e0-48ad-b9f7-4cd6c58c51b1 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:17.228921 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd6dc9b0-79e0-48ad-b9f7-4cd6c58c51b1 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:17.371714 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:59:17.434718 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f36632be-2cb6-4858-925c-4f1cf3f67c8d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:17.442566 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f36632be-2cb6-4858-925c-4f1cf3f67c8d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed" status: 200 len: 1370 microversion: 2.1 time: 0.358682 Sep 07 15:59:17.443279 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 249/481] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:17 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed => generated 1370 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:59:17.447177 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-fd6dc9b0-79e0-48ad-b9f7-4cd6c58c51b1 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:17.466851 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fd6dc9b0-79e0-48ad-b9f7-4cd6c58c51b1 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1358 microversion: 2.1 time: 0.260070 Sep 07 15:59:17.467538 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 233/482] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:17 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1358 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:59:17.530777 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2f5934b0-40ce-4260-8580-69c8a9b016c4 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:17.531378 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2f5934b0-40ce-4260-8580-69c8a9b016c4 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 7807823a-6888-4edf-90cf-3f72de9017c7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:17.537318 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f5934b0-40ce-4260-8580-69c8a9b016c4 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:17.537800 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f5934b0-40ce-4260-8580-69c8a9b016c4 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:17.538235 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f5934b0-40ce-4260-8580-69c8a9b016c4 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:17.538918 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f5934b0-40ce-4260-8580-69c8a9b016c4 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:17.539371 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f5934b0-40ce-4260-8580-69c8a9b016c4 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:17.539825 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f5934b0-40ce-4260-8580-69c8a9b016c4 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:17.603673 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2f5934b0-40ce-4260-8580-69c8a9b016c4 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e9cc0ef8394696b127a32edd75e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8213db22feb041c196d02aaeac22d875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:17.611465 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2f5934b0-40ce-4260-8580-69c8a9b016c4 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7" status: 200 len: 1271 microversion: 2.1 time: 0.085107 Sep 07 15:59:17.612064 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 250/483] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:17 2022] GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7 => generated 1271 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:59:18.466671 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bb78b668-9dec-443a-8ab1-b59343c3335a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:18.467420 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bb78b668-9dec-443a-8ab1-b59343c3335a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:18.472947 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=8 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:59:18.480976 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bb78b668-9dec-443a-8ab1-b59343c3335a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:18.481981 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bb78b668-9dec-443a-8ab1-b59343c3335a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:18.481981 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bb78b668-9dec-443a-8ab1-b59343c3335a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:18.482641 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bb78b668-9dec-443a-8ab1-b59343c3335a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:18.483128 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bb78b668-9dec-443a-8ab1-b59343c3335a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:18.483603 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bb78b668-9dec-443a-8ab1-b59343c3335a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:18.491653 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-50fdbf8a-cef2-4802-97d3-9881041588cb tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:18.492260 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-50fdbf8a-cef2-4802-97d3-9881041588cb tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:18.501208 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50fdbf8a-cef2-4802-97d3-9881041588cb tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:18.502114 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50fdbf8a-cef2-4802-97d3-9881041588cb tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:18.502802 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50fdbf8a-cef2-4802-97d3-9881041588cb tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:18.503926 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50fdbf8a-cef2-4802-97d3-9881041588cb tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:18.504571 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50fdbf8a-cef2-4802-97d3-9881041588cb tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:18.505838 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50fdbf8a-cef2-4802-97d3-9881041588cb tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:18.634750 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-bb78b668-9dec-443a-8ab1-b59343c3335a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:18.645441 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bb78b668-9dec-443a-8ab1-b59343c3335a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed" status: 200 len: 1565 microversion: 2.1 time: 0.182510 Sep 07 15:59:18.646350 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 234/484] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:18 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed => generated 1565 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:59:18.659349 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7eb98a11-5c8c-4e35-aa5a-da040161a0c0 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:18.659802 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-50fdbf8a-cef2-4802-97d3-9881041588cb tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:18.660192 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7eb98a11-5c8c-4e35-aa5a-da040161a0c0 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 7807823a-6888-4edf-90cf-3f72de9017c7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:18.669742 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-50fdbf8a-cef2-4802-97d3-9881041588cb tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1358 microversion: 2.1 time: 0.183068 Sep 07 15:59:18.670930 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 251/485] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:18 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:59:18.675730 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7eb98a11-5c8c-4e35-aa5a-da040161a0c0 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:18.676221 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7eb98a11-5c8c-4e35-aa5a-da040161a0c0 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:18.676522 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9f7394b5-b931-475b-84a6-90605725fb2d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:18.676659 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7eb98a11-5c8c-4e35-aa5a-da040161a0c0 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:18.677124 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9f7394b5-b931-475b-84a6-90605725fb2d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:18.677637 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7eb98a11-5c8c-4e35-aa5a-da040161a0c0 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:18.678102 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7eb98a11-5c8c-4e35-aa5a-da040161a0c0 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:18.678531 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7eb98a11-5c8c-4e35-aa5a-da040161a0c0 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:18.682772 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=100 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:59:18.684823 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9f7394b5-b931-475b-84a6-90605725fb2d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:18.685538 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9f7394b5-b931-475b-84a6-90605725fb2d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:18.686323 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9f7394b5-b931-475b-84a6-90605725fb2d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:18.687224 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9f7394b5-b931-475b-84a6-90605725fb2d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:18.687765 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9f7394b5-b931-475b-84a6-90605725fb2d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:18.688250 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9f7394b5-b931-475b-84a6-90605725fb2d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:18.767466 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-7eb98a11-5c8c-4e35-aa5a-da040161a0c0 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e9cc0ef8394696b127a32edd75e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8213db22feb041c196d02aaeac22d875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:18.775004 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7eb98a11-5c8c-4e35-aa5a-da040161a0c0 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7" status: 200 len: 1271 microversion: 2.1 time: 0.119521 Sep 07 15:59:18.775570 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 235/486] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:18 2022] GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7 => generated 1271 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:59:18.776727 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9f7394b5-b931-475b-84a6-90605725fb2d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.104419 Sep 07 15:59:18.777367 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 252/487] 10.222.0.17 () {58 vars in 1275 bytes} [Wed Sep 7 15:59:18 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:59:19.702922 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-628bb8ac-d215-4c13-a8cf-8c29a1e0184a tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:19.703651 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-628bb8ac-d215-4c13-a8cf-8c29a1e0184a tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:19.710709 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-628bb8ac-d215-4c13-a8cf-8c29a1e0184a tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:19.711204 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-628bb8ac-d215-4c13-a8cf-8c29a1e0184a tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:19.711803 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-628bb8ac-d215-4c13-a8cf-8c29a1e0184a tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:19.712569 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-628bb8ac-d215-4c13-a8cf-8c29a1e0184a tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:19.713089 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-628bb8ac-d215-4c13-a8cf-8c29a1e0184a tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:19.713575 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-628bb8ac-d215-4c13-a8cf-8c29a1e0184a tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:19.769488 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fd5596f5-27a8-41ee-b341-87561efe80f0 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:59:19.770060 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fd5596f5-27a8-41ee-b341-87561efe80f0 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:19.776895 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd5596f5-27a8-41ee-b341-87561efe80f0 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:19.777164 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd5596f5-27a8-41ee-b341-87561efe80f0 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:19.777812 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd5596f5-27a8-41ee-b341-87561efe80f0 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:19.778740 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd5596f5-27a8-41ee-b341-87561efe80f0 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:19.779427 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd5596f5-27a8-41ee-b341-87561efe80f0 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:19.780332 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd5596f5-27a8-41ee-b341-87561efe80f0 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:19.806282 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-fd5596f5-27a8-41ee-b341-87561efe80f0 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lazy-loading 'flavor' on Instance uuid 331c4dfb-7ee1-4585-bed9-2e65fa1f062a {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 15:59:19.876635 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-628bb8ac-d215-4c13-a8cf-8c29a1e0184a tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:19.885552 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-628bb8ac-d215-4c13-a8cf-8c29a1e0184a tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1358 microversion: 2.1 time: 0.187595 Sep 07 15:59:19.886517 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 236/488] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:19 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:59:19.906304 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-09f13755-a39d-45d3-83ae-4f9a5eb6cddd tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:19.908094 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-09f13755-a39d-45d3-83ae-4f9a5eb6cddd tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 7807823a-6888-4edf-90cf-3f72de9017c7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:19.925225 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-09f13755-a39d-45d3-83ae-4f9a5eb6cddd tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:19.925930 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-09f13755-a39d-45d3-83ae-4f9a5eb6cddd tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:19.926430 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-09f13755-a39d-45d3-83ae-4f9a5eb6cddd tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:19.927191 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-09f13755-a39d-45d3-83ae-4f9a5eb6cddd tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:19.928165 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-09f13755-a39d-45d3-83ae-4f9a5eb6cddd tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:19.930006 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-09f13755-a39d-45d3-83ae-4f9a5eb6cddd tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:20.008291 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-09f13755-a39d-45d3-83ae-4f9a5eb6cddd tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e9cc0ef8394696b127a32edd75e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8213db22feb041c196d02aaeac22d875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:20.017778 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-09f13755-a39d-45d3-83ae-4f9a5eb6cddd tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7" status: 200 len: 1277 microversion: 2.1 time: 0.128156 Sep 07 15:59:20.018867 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 237/489] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:19 2022] GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7 => generated 1277 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:59:20.103234 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fd5596f5-27a8-41ee-b341-87561efe80f0 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "POST /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a/action" status: 202 len: 0 microversion: 2.20 time: 0.337733 Sep 07 15:59:20.104265 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 253/490] 10.222.0.17 () {62 vars in 1319 bytes} [Wed Sep 7 15:59:19 2022] POST /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a/action => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 07 15:59:20.112671 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-836f1800-4414-4f83-888c-64c0738057bb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:20.113275 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-836f1800-4414-4f83-888c-64c0738057bb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:20.119141 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-836f1800-4414-4f83-888c-64c0738057bb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:20.119654 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-836f1800-4414-4f83-888c-64c0738057bb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:20.120358 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-836f1800-4414-4f83-888c-64c0738057bb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:20.120752 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-836f1800-4414-4f83-888c-64c0738057bb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:20.121221 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-836f1800-4414-4f83-888c-64c0738057bb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:20.121703 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-836f1800-4414-4f83-888c-64c0738057bb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:20.263837 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-836f1800-4414-4f83-888c-64c0738057bb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:20.271886 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-836f1800-4414-4f83-888c-64c0738057bb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:20.273404 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-836f1800-4414-4f83-888c-64c0738057bb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:20.274626 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-836f1800-4414-4f83-888c-64c0738057bb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1722 microversion: 2.20 time: 0.165747 Sep 07 15:59:20.275177 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 238/491] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:59:20 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:59:20.431922 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-5c7f4df1-bd52-4a50-a7ec-0d583124b8c8 req-512cd237-e096-4a99-ba28-98a2ba4c11ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92a9f013-5f7f-442b-84d8-f61470d999ed", "tag": "a060693c-99c1-4033-a3a8-1384e673c07a"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:59:20.443328 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-5c7f4df1-bd52-4a50-a7ec-0d583124b8c8 req-512cd237-e096-4a99-ba28-98a2ba4c11ea service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:20.443826 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-5c7f4df1-bd52-4a50-a7ec-0d583124b8c8 req-512cd237-e096-4a99-ba28-98a2ba4c11ea service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:20.444655 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-5c7f4df1-bd52-4a50-a7ec-0d583124b8c8 req-512cd237-e096-4a99-ba28-98a2ba4c11ea service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:20.456291 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-5c7f4df1-bd52-4a50-a7ec-0d583124b8c8 req-512cd237-e096-4a99-ba28-98a2ba4c11ea service nova] Creating event network-changed:a060693c-99c1-4033-a3a8-1384e673c07a for instance 92a9f013-5f7f-442b-84d8-f61470d999ed on hv-cinder-85331 Sep 07 15:59:20.461881 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-5c7f4df1-bd52-4a50-a7ec-0d583124b8c8 req-512cd237-e096-4a99-ba28-98a2ba4c11ea service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034838 Sep 07 15:59:20.462801 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 254/492] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 15:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:59:20.909867 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fd104914-2d4c-4423-96a9-282462a7d25f tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:20.910588 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fd104914-2d4c-4423-96a9-282462a7d25f tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:20.917135 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd104914-2d4c-4423-96a9-282462a7d25f tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:20.917615 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd104914-2d4c-4423-96a9-282462a7d25f tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:20.918071 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd104914-2d4c-4423-96a9-282462a7d25f tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:20.919320 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd104914-2d4c-4423-96a9-282462a7d25f tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:20.919801 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd104914-2d4c-4423-96a9-282462a7d25f tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:20.920221 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd104914-2d4c-4423-96a9-282462a7d25f tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:21.044023 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9e20e27c-6375-4336-beb1-700f10cbea07 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:21.045750 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9e20e27c-6375-4336-beb1-700f10cbea07 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 7807823a-6888-4edf-90cf-3f72de9017c7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:21.047721 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-fd104914-2d4c-4423-96a9-282462a7d25f tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:21.055576 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e20e27c-6375-4336-beb1-700f10cbea07 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:21.055939 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fd104914-2d4c-4423-96a9-282462a7d25f tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1358 microversion: 2.1 time: 0.149801 Sep 07 15:59:21.056311 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e20e27c-6375-4336-beb1-700f10cbea07 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:21.056843 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e20e27c-6375-4336-beb1-700f10cbea07 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:21.057014 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 239/493] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:20 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:59:21.057797 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e20e27c-6375-4336-beb1-700f10cbea07 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:21.058835 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e20e27c-6375-4336-beb1-700f10cbea07 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:21.059372 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9e20e27c-6375-4336-beb1-700f10cbea07 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:21.192840 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9e20e27c-6375-4336-beb1-700f10cbea07 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e9cc0ef8394696b127a32edd75e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8213db22feb041c196d02aaeac22d875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:21.201252 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9e20e27c-6375-4336-beb1-700f10cbea07 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7" status: 200 len: 1319 microversion: 2.1 time: 0.162072 Sep 07 15:59:21.201850 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 255/494] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:21 2022] GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:59:21.300499 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dd8d3b7e-ed28-4984-aaf8-5c384f429623 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:21.301219 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-dd8d3b7e-ed28-4984-aaf8-5c384f429623 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:21.307212 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd8d3b7e-ed28-4984-aaf8-5c384f429623 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:21.307733 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd8d3b7e-ed28-4984-aaf8-5c384f429623 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:21.308165 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd8d3b7e-ed28-4984-aaf8-5c384f429623 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:21.309042 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd8d3b7e-ed28-4984-aaf8-5c384f429623 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:21.309488 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd8d3b7e-ed28-4984-aaf8-5c384f429623 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:21.309903 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd8d3b7e-ed28-4984-aaf8-5c384f429623 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:21.441221 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-dd8d3b7e-ed28-4984-aaf8-5c384f429623 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:21.449526 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-dd8d3b7e-ed28-4984-aaf8-5c384f429623 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:21.451037 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-dd8d3b7e-ed28-4984-aaf8-5c384f429623 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:21.452293 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-dd8d3b7e-ed28-4984-aaf8-5c384f429623 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1722 microversion: 2.20 time: 0.155766 Sep 07 15:59:21.453126 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 240/495] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:59:21 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:59:22.080150 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8446c061-6201-40fb-acff-6088dc89bc95 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:22.080760 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8446c061-6201-40fb-acff-6088dc89bc95 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:22.082700 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:59:22.087976 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8446c061-6201-40fb-acff-6088dc89bc95 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:22.088463 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8446c061-6201-40fb-acff-6088dc89bc95 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:22.088900 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8446c061-6201-40fb-acff-6088dc89bc95 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:22.089588 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8446c061-6201-40fb-acff-6088dc89bc95 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:22.090700 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8446c061-6201-40fb-acff-6088dc89bc95 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:22.091128 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8446c061-6201-40fb-acff-6088dc89bc95 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:22.096330 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:59:22.223876 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a073effb-a3cb-41e9-9adc-195c638959ac tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:22.224493 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a073effb-a3cb-41e9-9adc-195c638959ac tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 7807823a-6888-4edf-90cf-3f72de9017c7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:22.224705 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-8446c061-6201-40fb-acff-6088dc89bc95 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:22.227084 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:59:22.232379 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a073effb-a3cb-41e9-9adc-195c638959ac tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:22.232854 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8446c061-6201-40fb-acff-6088dc89bc95 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1358 microversion: 2.1 time: 0.156527 Sep 07 15:59:22.232976 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a073effb-a3cb-41e9-9adc-195c638959ac tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:22.233289 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a073effb-a3cb-41e9-9adc-195c638959ac tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:22.241240 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 256/496] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:22 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:59:22.241394 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a073effb-a3cb-41e9-9adc-195c638959ac tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:22.241394 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a073effb-a3cb-41e9-9adc-195c638959ac tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:22.241394 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a073effb-a3cb-41e9-9adc-195c638959ac tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:22.362374 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-a073effb-a3cb-41e9-9adc-195c638959ac tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e9cc0ef8394696b127a32edd75e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8213db22feb041c196d02aaeac22d875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:22.369954 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a073effb-a3cb-41e9-9adc-195c638959ac tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7" status: 200 len: 1319 microversion: 2.1 time: 0.150067 Sep 07 15:59:22.370515 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 241/497] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:22 2022] GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:59:22.478158 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-da688298-80c4-4d32-ab6f-c17d970d7cf2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:22.478760 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-da688298-80c4-4d32-ab6f-c17d970d7cf2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:22.485286 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da688298-80c4-4d32-ab6f-c17d970d7cf2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:22.485760 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da688298-80c4-4d32-ab6f-c17d970d7cf2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:22.486189 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da688298-80c4-4d32-ab6f-c17d970d7cf2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:22.486868 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da688298-80c4-4d32-ab6f-c17d970d7cf2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:22.487312 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da688298-80c4-4d32-ab6f-c17d970d7cf2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:22.487757 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da688298-80c4-4d32-ab6f-c17d970d7cf2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:22.615464 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-da688298-80c4-4d32-ab6f-c17d970d7cf2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:22.624309 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-da688298-80c4-4d32-ab6f-c17d970d7cf2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:22.625833 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-da688298-80c4-4d32-ab6f-c17d970d7cf2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:22.627015 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-da688298-80c4-4d32-ab6f-c17d970d7cf2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1722 microversion: 2.20 time: 0.153001 Sep 07 15:59:22.627587 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 257/498] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:59:22 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:59:23.256328 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c5057c6f-43d7-4b52-a5df-eece413a64a9 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:23.256939 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c5057c6f-43d7-4b52-a5df-eece413a64a9 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:23.263835 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c5057c6f-43d7-4b52-a5df-eece413a64a9 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:23.264315 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c5057c6f-43d7-4b52-a5df-eece413a64a9 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:23.264746 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c5057c6f-43d7-4b52-a5df-eece413a64a9 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:23.265425 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c5057c6f-43d7-4b52-a5df-eece413a64a9 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:23.265877 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c5057c6f-43d7-4b52-a5df-eece413a64a9 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:23.266295 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c5057c6f-43d7-4b52-a5df-eece413a64a9 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:23.393389 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8d131963-ce86-4164-a294-12bd35b1d06b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:23.393924 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8d131963-ce86-4164-a294-12bd35b1d06b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 7807823a-6888-4edf-90cf-3f72de9017c7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:23.396729 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-c5057c6f-43d7-4b52-a5df-eece413a64a9 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:23.399977 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8d131963-ce86-4164-a294-12bd35b1d06b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:23.400532 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8d131963-ce86-4164-a294-12bd35b1d06b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:23.401039 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8d131963-ce86-4164-a294-12bd35b1d06b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:23.401799 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8d131963-ce86-4164-a294-12bd35b1d06b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:23.402325 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8d131963-ce86-4164-a294-12bd35b1d06b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:23.403333 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8d131963-ce86-4164-a294-12bd35b1d06b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:23.404996 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c5057c6f-43d7-4b52-a5df-eece413a64a9 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1358 microversion: 2.1 time: 0.152443 Sep 07 15:59:23.405662 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 242/499] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:23 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:59:23.528204 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-8d131963-ce86-4164-a294-12bd35b1d06b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e9cc0ef8394696b127a32edd75e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8213db22feb041c196d02aaeac22d875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:23.535708 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8d131963-ce86-4164-a294-12bd35b1d06b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7" status: 200 len: 1319 microversion: 2.1 time: 0.146211 Sep 07 15:59:23.536267 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 258/500] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:23 2022] GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:59:23.652545 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8f084505-bde4-442e-ab32-52ba57e9e564 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:23.653062 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8f084505-bde4-442e-ab32-52ba57e9e564 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:23.658933 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f084505-bde4-442e-ab32-52ba57e9e564 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:23.659406 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f084505-bde4-442e-ab32-52ba57e9e564 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:23.659969 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f084505-bde4-442e-ab32-52ba57e9e564 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:23.660645 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f084505-bde4-442e-ab32-52ba57e9e564 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:23.661089 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f084505-bde4-442e-ab32-52ba57e9e564 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:23.661508 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8f084505-bde4-442e-ab32-52ba57e9e564 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:23.981964 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-8f084505-bde4-442e-ab32-52ba57e9e564 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:23.989909 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-8f084505-bde4-442e-ab32-52ba57e9e564 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:23.991327 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-8f084505-bde4-442e-ab32-52ba57e9e564 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:23.992486 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8f084505-bde4-442e-ab32-52ba57e9e564 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1722 microversion: 2.20 time: 0.344002 Sep 07 15:59:23.993033 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 243/501] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:59:23 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1722 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:59:24.427632 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-da4afbad-87f3-4ee0-8243-bab7e8039e36 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:24.428236 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-da4afbad-87f3-4ee0-8243-bab7e8039e36 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:24.434448 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da4afbad-87f3-4ee0-8243-bab7e8039e36 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:24.434921 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da4afbad-87f3-4ee0-8243-bab7e8039e36 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:24.435345 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da4afbad-87f3-4ee0-8243-bab7e8039e36 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:24.436061 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da4afbad-87f3-4ee0-8243-bab7e8039e36 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:24.436534 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da4afbad-87f3-4ee0-8243-bab7e8039e36 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:24.436945 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-da4afbad-87f3-4ee0-8243-bab7e8039e36 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:24.557644 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b0eef0ef-0024-43fc-be61-9f8707903f6b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:24.558346 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b0eef0ef-0024-43fc-be61-9f8707903f6b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 7807823a-6888-4edf-90cf-3f72de9017c7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:24.564519 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-da4afbad-87f3-4ee0-8243-bab7e8039e36 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:24.564708 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b0eef0ef-0024-43fc-be61-9f8707903f6b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:24.565199 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b0eef0ef-0024-43fc-be61-9f8707903f6b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:24.565637 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b0eef0ef-0024-43fc-be61-9f8707903f6b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:24.566329 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b0eef0ef-0024-43fc-be61-9f8707903f6b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:24.566781 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b0eef0ef-0024-43fc-be61-9f8707903f6b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:24.567201 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b0eef0ef-0024-43fc-be61-9f8707903f6b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:24.572289 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-da4afbad-87f3-4ee0-8243-bab7e8039e36 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1358 microversion: 2.1 time: 0.148456 Sep 07 15:59:24.572874 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 259/502] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:24 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:59:24.698747 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-b0eef0ef-0024-43fc-be61-9f8707903f6b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e9cc0ef8394696b127a32edd75e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8213db22feb041c196d02aaeac22d875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:24.706814 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b0eef0ef-0024-43fc-be61-9f8707903f6b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7" status: 200 len: 1319 microversion: 2.1 time: 0.153077 Sep 07 15:59:24.707372 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 244/503] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:24 2022] GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:59:25.018601 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-05e2523e-d55c-46eb-ba32-1562fbcb10ea tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:25.019197 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-05e2523e-d55c-46eb-ba32-1562fbcb10ea tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:25.025049 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-05e2523e-d55c-46eb-ba32-1562fbcb10ea tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:25.025525 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-05e2523e-d55c-46eb-ba32-1562fbcb10ea tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:25.025946 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-05e2523e-d55c-46eb-ba32-1562fbcb10ea tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:25.026614 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-05e2523e-d55c-46eb-ba32-1562fbcb10ea tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:25.027057 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-05e2523e-d55c-46eb-ba32-1562fbcb10ea tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:25.028072 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-05e2523e-d55c-46eb-ba32-1562fbcb10ea tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:25.154735 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-05e2523e-d55c-46eb-ba32-1562fbcb10ea tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:25.162747 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-05e2523e-d55c-46eb-ba32-1562fbcb10ea tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:25.164194 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-05e2523e-d55c-46eb-ba32-1562fbcb10ea tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:25.165334 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-05e2523e-d55c-46eb-ba32-1562fbcb10ea tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1722 microversion: 2.20 time: 0.150611 Sep 07 15:59:25.165873 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 260/504] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:59:25 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:59:25.596258 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0d508bb0-ee7b-4a20-91ec-1ab8c9e8ef88 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:25.596859 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0d508bb0-ee7b-4a20-91ec-1ab8c9e8ef88 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:25.603407 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d508bb0-ee7b-4a20-91ec-1ab8c9e8ef88 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:25.603914 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d508bb0-ee7b-4a20-91ec-1ab8c9e8ef88 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:25.604341 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d508bb0-ee7b-4a20-91ec-1ab8c9e8ef88 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:25.605013 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d508bb0-ee7b-4a20-91ec-1ab8c9e8ef88 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:25.605982 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d508bb0-ee7b-4a20-91ec-1ab8c9e8ef88 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:25.606408 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0d508bb0-ee7b-4a20-91ec-1ab8c9e8ef88 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:25.729983 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0de7ca49-5851-4f99-8bea-142a11d81ffa tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:25.731518 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0de7ca49-5851-4f99-8bea-142a11d81ffa tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 7807823a-6888-4edf-90cf-3f72de9017c7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:25.733762 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-0d508bb0-ee7b-4a20-91ec-1ab8c9e8ef88 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:25.738308 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0de7ca49-5851-4f99-8bea-142a11d81ffa tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:25.738890 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0de7ca49-5851-4f99-8bea-142a11d81ffa tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:25.739326 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0de7ca49-5851-4f99-8bea-142a11d81ffa tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:25.740048 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0de7ca49-5851-4f99-8bea-142a11d81ffa tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:25.740522 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0de7ca49-5851-4f99-8bea-142a11d81ffa tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:25.740975 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0de7ca49-5851-4f99-8bea-142a11d81ffa tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:25.741351 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0d508bb0-ee7b-4a20-91ec-1ab8c9e8ef88 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1358 microversion: 2.1 time: 0.148870 Sep 07 15:59:25.741915 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 245/505] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:25 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:59:25.867922 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-0de7ca49-5851-4f99-8bea-142a11d81ffa tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e9cc0ef8394696b127a32edd75e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8213db22feb041c196d02aaeac22d875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:25.876043 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0de7ca49-5851-4f99-8bea-142a11d81ffa tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7" status: 200 len: 1319 microversion: 2.1 time: 0.149912 Sep 07 15:59:25.876595 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 261/506] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:25 2022] GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:59:26.189867 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ab5f0245-133d-4172-8463-f3c27568e2c0 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:26.190476 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ab5f0245-133d-4172-8463-f3c27568e2c0 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:26.196727 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab5f0245-133d-4172-8463-f3c27568e2c0 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:26.197207 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab5f0245-133d-4172-8463-f3c27568e2c0 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:26.197640 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab5f0245-133d-4172-8463-f3c27568e2c0 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:26.198320 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab5f0245-133d-4172-8463-f3c27568e2c0 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:26.198772 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab5f0245-133d-4172-8463-f3c27568e2c0 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:26.199735 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ab5f0245-133d-4172-8463-f3c27568e2c0 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:26.326864 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-ab5f0245-133d-4172-8463-f3c27568e2c0 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:26.334958 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-ab5f0245-133d-4172-8463-f3c27568e2c0 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:26.336420 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-ab5f0245-133d-4172-8463-f3c27568e2c0 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:26.337566 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ab5f0245-133d-4172-8463-f3c27568e2c0 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1722 microversion: 2.20 time: 0.151906 Sep 07 15:59:26.338116 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 246/507] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:59:26 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:59:26.776733 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7ee3437e-ef5c-470f-aa9c-f6e767d97191 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:26.776733 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7ee3437e-ef5c-470f-aa9c-f6e767d97191 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:26.779825 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ee3437e-ef5c-470f-aa9c-f6e767d97191 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:26.780315 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ee3437e-ef5c-470f-aa9c-f6e767d97191 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:26.785599 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ee3437e-ef5c-470f-aa9c-f6e767d97191 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:26.786698 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ee3437e-ef5c-470f-aa9c-f6e767d97191 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:26.788849 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ee3437e-ef5c-470f-aa9c-f6e767d97191 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:26.791045 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ee3437e-ef5c-470f-aa9c-f6e767d97191 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:26.902105 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c71f1614-1b11-4111-ae71-897164cf4170 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:26.903516 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c71f1614-1b11-4111-ae71-897164cf4170 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 7807823a-6888-4edf-90cf-3f72de9017c7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:26.913052 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c71f1614-1b11-4111-ae71-897164cf4170 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:26.913625 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c71f1614-1b11-4111-ae71-897164cf4170 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:26.914129 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c71f1614-1b11-4111-ae71-897164cf4170 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:26.914992 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c71f1614-1b11-4111-ae71-897164cf4170 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:26.915462 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c71f1614-1b11-4111-ae71-897164cf4170 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:26.916112 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c71f1614-1b11-4111-ae71-897164cf4170 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:27.061718 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7ee3437e-ef5c-470f-aa9c-f6e767d97191 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:27.071680 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7ee3437e-ef5c-470f-aa9c-f6e767d97191 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1358 microversion: 2.1 time: 0.309220 Sep 07 15:59:27.072426 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 262/508] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:26 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1358 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:59:27.141974 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-c71f1614-1b11-4111-ae71-897164cf4170 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e9cc0ef8394696b127a32edd75e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8213db22feb041c196d02aaeac22d875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:27.149747 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c71f1614-1b11-4111-ae71-897164cf4170 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7" status: 200 len: 1319 microversion: 2.1 time: 0.252705 Sep 07 15:59:27.150486 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 247/509] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:26 2022] GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7 => generated 1319 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:59:27.363972 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-42074a09-6342-406c-9106-9d27047085ee tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:27.364906 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-42074a09-6342-406c-9106-9d27047085ee tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:27.370861 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42074a09-6342-406c-9106-9d27047085ee tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:27.372211 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42074a09-6342-406c-9106-9d27047085ee tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:27.372825 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42074a09-6342-406c-9106-9d27047085ee tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:27.373679 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42074a09-6342-406c-9106-9d27047085ee tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:27.374285 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42074a09-6342-406c-9106-9d27047085ee tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:27.374881 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-42074a09-6342-406c-9106-9d27047085ee tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:27.566980 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-42074a09-6342-406c-9106-9d27047085ee tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:27.575831 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-42074a09-6342-406c-9106-9d27047085ee tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:27.577261 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-42074a09-6342-406c-9106-9d27047085ee tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:27.578442 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-42074a09-6342-406c-9106-9d27047085ee tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1722 microversion: 2.20 time: 0.218486 Sep 07 15:59:27.578958 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 263/510] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:59:27 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1722 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:59:27.598589 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-b97bc1b4-8f17-4b6f-bb08-535e457aca37 req-74d73cbc-a247-4c24-826f-4c19fd1ad3ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7807823a-6888-4edf-90cf-3f72de9017c7", "tag": "d4135853-bbb1-4003-986f-0834bf734654"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:59:27.610739 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-b97bc1b4-8f17-4b6f-bb08-535e457aca37 req-74d73cbc-a247-4c24-826f-4c19fd1ad3ed service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:27.611344 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-b97bc1b4-8f17-4b6f-bb08-535e457aca37 req-74d73cbc-a247-4c24-826f-4c19fd1ad3ed service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:27.611870 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-b97bc1b4-8f17-4b6f-bb08-535e457aca37 req-74d73cbc-a247-4c24-826f-4c19fd1ad3ed service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:27.623406 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-b97bc1b4-8f17-4b6f-bb08-535e457aca37 req-74d73cbc-a247-4c24-826f-4c19fd1ad3ed service nova] Creating event network-changed:d4135853-bbb1-4003-986f-0834bf734654 for instance 7807823a-6888-4edf-90cf-3f72de9017c7 on hv-cinder-85331 Sep 07 15:59:27.628378 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-b97bc1b4-8f17-4b6f-bb08-535e457aca37 req-74d73cbc-a247-4c24-826f-4c19fd1ad3ed service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035298 Sep 07 15:59:27.629209 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 248/511] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 15:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:59:28.095265 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-490dc7fb-648e-4e62-bf39-fb5a54105d67 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:28.095844 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-490dc7fb-648e-4e62-bf39-fb5a54105d67 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:28.113603 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-490dc7fb-648e-4e62-bf39-fb5a54105d67 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:28.113603 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-490dc7fb-648e-4e62-bf39-fb5a54105d67 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:28.113603 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-490dc7fb-648e-4e62-bf39-fb5a54105d67 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:28.113603 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-490dc7fb-648e-4e62-bf39-fb5a54105d67 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:28.114172 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-490dc7fb-648e-4e62-bf39-fb5a54105d67 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:28.114172 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-490dc7fb-648e-4e62-bf39-fb5a54105d67 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:28.174480 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1da1f489-5364-48a6-b35b-c27eddf95a41 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:28.175188 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1da1f489-5364-48a6-b35b-c27eddf95a41 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 7807823a-6888-4edf-90cf-3f72de9017c7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:28.181334 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1da1f489-5364-48a6-b35b-c27eddf95a41 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:28.181814 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1da1f489-5364-48a6-b35b-c27eddf95a41 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:28.182260 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1da1f489-5364-48a6-b35b-c27eddf95a41 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:28.182940 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1da1f489-5364-48a6-b35b-c27eddf95a41 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:28.184076 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1da1f489-5364-48a6-b35b-c27eddf95a41 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:28.184479 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1da1f489-5364-48a6-b35b-c27eddf95a41 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:28.323357 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-1da1f489-5364-48a6-b35b-c27eddf95a41 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e9cc0ef8394696b127a32edd75e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8213db22feb041c196d02aaeac22d875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:28.332339 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1da1f489-5364-48a6-b35b-c27eddf95a41 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7" status: 200 len: 1319 microversion: 2.1 time: 0.162506 Sep 07 15:59:28.333020 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 249/512] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:28 2022] GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:59:28.354109 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-490dc7fb-648e-4e62-bf39-fb5a54105d67 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:28.362196 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-490dc7fb-648e-4e62-bf39-fb5a54105d67 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1358 microversion: 2.1 time: 0.271276 Sep 07 15:59:28.362774 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 264/513] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:28 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1358 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:59:28.604469 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0be5e6ef-9185-42fd-a6d5-42fac3c6647d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:28.605082 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0be5e6ef-9185-42fd-a6d5-42fac3c6647d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:28.611004 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0be5e6ef-9185-42fd-a6d5-42fac3c6647d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:28.611491 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0be5e6ef-9185-42fd-a6d5-42fac3c6647d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:28.611956 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0be5e6ef-9185-42fd-a6d5-42fac3c6647d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:28.612667 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0be5e6ef-9185-42fd-a6d5-42fac3c6647d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:28.613114 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0be5e6ef-9185-42fd-a6d5-42fac3c6647d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:28.613535 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0be5e6ef-9185-42fd-a6d5-42fac3c6647d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:28.744075 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-0be5e6ef-9185-42fd-a6d5-42fac3c6647d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:28.752308 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-0be5e6ef-9185-42fd-a6d5-42fac3c6647d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:28.753832 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-0be5e6ef-9185-42fd-a6d5-42fac3c6647d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:28.755142 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0be5e6ef-9185-42fd-a6d5-42fac3c6647d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1722 microversion: 2.20 time: 0.154855 Sep 07 15:59:28.755709 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 250/514] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:59:28 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:59:29.358034 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-38945658-f87a-4e3f-8d90-4c8443efcb7b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:29.358635 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-38945658-f87a-4e3f-8d90-4c8443efcb7b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 7807823a-6888-4edf-90cf-3f72de9017c7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:29.364919 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38945658-f87a-4e3f-8d90-4c8443efcb7b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:29.365389 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38945658-f87a-4e3f-8d90-4c8443efcb7b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:29.365814 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38945658-f87a-4e3f-8d90-4c8443efcb7b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:29.366493 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38945658-f87a-4e3f-8d90-4c8443efcb7b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:29.366937 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38945658-f87a-4e3f-8d90-4c8443efcb7b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:29.367353 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38945658-f87a-4e3f-8d90-4c8443efcb7b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:29.386229 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b74169b0-aebb-41a9-8a7a-2dfb3c38c239 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:29.386745 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b74169b0-aebb-41a9-8a7a-2dfb3c38c239 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:29.392817 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b74169b0-aebb-41a9-8a7a-2dfb3c38c239 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:29.393301 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b74169b0-aebb-41a9-8a7a-2dfb3c38c239 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:29.393732 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b74169b0-aebb-41a9-8a7a-2dfb3c38c239 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:29.394420 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b74169b0-aebb-41a9-8a7a-2dfb3c38c239 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:29.394874 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b74169b0-aebb-41a9-8a7a-2dfb3c38c239 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:29.395299 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b74169b0-aebb-41a9-8a7a-2dfb3c38c239 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:29.515700 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-38945658-f87a-4e3f-8d90-4c8443efcb7b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e9cc0ef8394696b127a32edd75e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8213db22feb041c196d02aaeac22d875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:29.523639 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-38945658-f87a-4e3f-8d90-4c8443efcb7b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7" status: 200 len: 1319 microversion: 2.1 time: 0.170271 Sep 07 15:59:29.524204 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 265/515] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:29 2022] GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:59:29.529428 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-b74169b0-aebb-41a9-8a7a-2dfb3c38c239 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:29.537561 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b74169b0-aebb-41a9-8a7a-2dfb3c38c239 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1358 microversion: 2.1 time: 0.155170 Sep 07 15:59:29.538144 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 251/516] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:29 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:59:29.780941 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fdf70d15-f790-4225-a761-7b8e4fab13f2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:29.781614 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fdf70d15-f790-4225-a761-7b8e4fab13f2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:29.788776 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fdf70d15-f790-4225-a761-7b8e4fab13f2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:29.789636 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fdf70d15-f790-4225-a761-7b8e4fab13f2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:29.790214 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fdf70d15-f790-4225-a761-7b8e4fab13f2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:29.791320 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fdf70d15-f790-4225-a761-7b8e4fab13f2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:29.791911 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fdf70d15-f790-4225-a761-7b8e4fab13f2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:29.792337 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fdf70d15-f790-4225-a761-7b8e4fab13f2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:29.917153 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-fdf70d15-f790-4225-a761-7b8e4fab13f2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:29.925808 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-fdf70d15-f790-4225-a761-7b8e4fab13f2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:29.927359 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-fdf70d15-f790-4225-a761-7b8e4fab13f2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:29.928632 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fdf70d15-f790-4225-a761-7b8e4fab13f2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1722 microversion: 2.20 time: 0.152171 Sep 07 15:59:29.929200 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 266/517] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:59:29 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:59:30.216042 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-fb9e8254-89ce-4afb-8e60-7cfaade295ba req-a592191c-a58c-4130-acbc-176015eee4bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84743d24-2644-46a9-86a3-030706f2ec33", "name": "network-vif-plugged", "status": "completed", "tag": "62d356d3-a43c-486d-a45b-1855b53e8a1d"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:59:30.226014 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-fb9e8254-89ce-4afb-8e60-7cfaade295ba req-a592191c-a58c-4130-acbc-176015eee4bb service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:30.226468 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-fb9e8254-89ce-4afb-8e60-7cfaade295ba req-a592191c-a58c-4130-acbc-176015eee4bb service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:30.226893 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-fb9e8254-89ce-4afb-8e60-7cfaade295ba req-a592191c-a58c-4130-acbc-176015eee4bb service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:30.238486 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-fb9e8254-89ce-4afb-8e60-7cfaade295ba req-a592191c-a58c-4130-acbc-176015eee4bb service nova] Creating event network-vif-plugged:62d356d3-a43c-486d-a45b-1855b53e8a1d for instance 84743d24-2644-46a9-86a3-030706f2ec33 on hv-cinder-85331 Sep 07 15:59:30.243224 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-fb9e8254-89ce-4afb-8e60-7cfaade295ba req-a592191c-a58c-4130-acbc-176015eee4bb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031530 Sep 07 15:59:30.244035 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 252/518] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 15:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:59:30.550526 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5c1f5c7c-ba89-42c7-9570-b02be241f4c1 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:30.551354 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5c1f5c7c-ba89-42c7-9570-b02be241f4c1 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 7807823a-6888-4edf-90cf-3f72de9017c7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:30.558258 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c1f5c7c-ba89-42c7-9570-b02be241f4c1 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:30.559325 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c1f5c7c-ba89-42c7-9570-b02be241f4c1 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:30.559857 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c1f5c7c-ba89-42c7-9570-b02be241f4c1 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:30.560555 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c1f5c7c-ba89-42c7-9570-b02be241f4c1 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:30.561046 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c1f5c7c-ba89-42c7-9570-b02be241f4c1 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:30.561478 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c1f5c7c-ba89-42c7-9570-b02be241f4c1 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:30.563971 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-70c04842-72e1-46e0-a38b-29b0955becb1 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:30.564845 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-70c04842-72e1-46e0-a38b-29b0955becb1 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:30.570934 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70c04842-72e1-46e0-a38b-29b0955becb1 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:30.571613 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70c04842-72e1-46e0-a38b-29b0955becb1 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:30.572011 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70c04842-72e1-46e0-a38b-29b0955becb1 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:30.572764 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70c04842-72e1-46e0-a38b-29b0955becb1 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:30.573401 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70c04842-72e1-46e0-a38b-29b0955becb1 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:30.574022 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70c04842-72e1-46e0-a38b-29b0955becb1 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:30.579120 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=100 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:59:30.721299 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5c1f5c7c-ba89-42c7-9570-b02be241f4c1 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e9cc0ef8394696b127a32edd75e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8213db22feb041c196d02aaeac22d875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:30.729865 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5c1f5c7c-ba89-42c7-9570-b02be241f4c1 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7" status: 200 len: 1319 microversion: 2.1 time: 0.184096 Sep 07 15:59:30.731577 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 267/519] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:30 2022] GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7 => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:59:30.749247 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-70c04842-72e1-46e0-a38b-29b0955becb1 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:30.757882 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-70c04842-72e1-46e0-a38b-29b0955becb1 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1358 microversion: 2.1 time: 0.199926 Sep 07 15:59:30.758439 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 253/520] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:30 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:59:30.954096 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-27cba383-9fd9-4eb8-ba07-6b7450deedff tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:30.954699 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-27cba383-9fd9-4eb8-ba07-6b7450deedff tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:30.960615 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-27cba383-9fd9-4eb8-ba07-6b7450deedff tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:30.961090 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-27cba383-9fd9-4eb8-ba07-6b7450deedff tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:30.961602 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-27cba383-9fd9-4eb8-ba07-6b7450deedff tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:30.962341 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-27cba383-9fd9-4eb8-ba07-6b7450deedff tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:30.962796 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-27cba383-9fd9-4eb8-ba07-6b7450deedff tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:30.963224 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-27cba383-9fd9-4eb8-ba07-6b7450deedff tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:31.092848 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-27cba383-9fd9-4eb8-ba07-6b7450deedff tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:31.101087 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-27cba383-9fd9-4eb8-ba07-6b7450deedff tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:31.102527 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-27cba383-9fd9-4eb8-ba07-6b7450deedff tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:31.103712 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-27cba383-9fd9-4eb8-ba07-6b7450deedff tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1722 microversion: 2.20 time: 0.153617 Sep 07 15:59:31.104260 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 268/521] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:59:30 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 15:59:31.755851 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fd348073-d871-4377-a936-4193c840136f tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:31.757277 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fd348073-d871-4377-a936-4193c840136f tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 7807823a-6888-4edf-90cf-3f72de9017c7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:31.763916 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd348073-d871-4377-a936-4193c840136f tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:31.764325 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd348073-d871-4377-a936-4193c840136f tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:31.764750 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd348073-d871-4377-a936-4193c840136f tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:31.765433 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd348073-d871-4377-a936-4193c840136f tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:31.765877 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd348073-d871-4377-a936-4193c840136f tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:31.766323 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd348073-d871-4377-a936-4193c840136f tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:31.781121 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3e17242a-497d-4cb8-84e6-5d03910cf205 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:31.781911 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3e17242a-497d-4cb8-84e6-5d03910cf205 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:31.789518 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e17242a-497d-4cb8-84e6-5d03910cf205 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:31.789995 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e17242a-497d-4cb8-84e6-5d03910cf205 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:31.790647 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e17242a-497d-4cb8-84e6-5d03910cf205 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:31.791350 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e17242a-497d-4cb8-84e6-5d03910cf205 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:31.791837 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e17242a-497d-4cb8-84e6-5d03910cf205 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:31.792266 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e17242a-497d-4cb8-84e6-5d03910cf205 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:31.913282 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-fd348073-d871-4377-a936-4193c840136f tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e9cc0ef8394696b127a32edd75e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8213db22feb041c196d02aaeac22d875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:31.922324 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fd348073-d871-4377-a936-4193c840136f tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7" status: 200 len: 1319 microversion: 2.1 time: 0.171751 Sep 07 15:59:31.922909 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 254/522] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:31 2022] GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:59:31.930653 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3e17242a-497d-4cb8-84e6-5d03910cf205 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:31.938785 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3e17242a-497d-4cb8-84e6-5d03910cf205 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1358 microversion: 2.1 time: 0.162061 Sep 07 15:59:31.939338 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 269/523] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:31 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:59:32.130127 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fcbb941a-5435-4851-9d68-d3f829e31777 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:32.131188 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fcbb941a-5435-4851-9d68-d3f829e31777 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:32.138507 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fcbb941a-5435-4851-9d68-d3f829e31777 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:32.138919 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fcbb941a-5435-4851-9d68-d3f829e31777 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:32.139481 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fcbb941a-5435-4851-9d68-d3f829e31777 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:32.140271 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fcbb941a-5435-4851-9d68-d3f829e31777 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:32.140832 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fcbb941a-5435-4851-9d68-d3f829e31777 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:32.141321 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fcbb941a-5435-4851-9d68-d3f829e31777 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:32.278427 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-fcbb941a-5435-4851-9d68-d3f829e31777 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:32.286411 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-fcbb941a-5435-4851-9d68-d3f829e31777 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:32.287874 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-fcbb941a-5435-4851-9d68-d3f829e31777 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:32.289152 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fcbb941a-5435-4851-9d68-d3f829e31777 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1722 microversion: 2.20 time: 0.163006 Sep 07 15:59:32.289696 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 255/524] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:59:32 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:59:32.945182 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5457835d-40ac-42c0-932d-23c1b1d03afc tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:32.945832 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5457835d-40ac-42c0-932d-23c1b1d03afc tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 7807823a-6888-4edf-90cf-3f72de9017c7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:32.952198 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5457835d-40ac-42c0-932d-23c1b1d03afc tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:32.952673 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5457835d-40ac-42c0-932d-23c1b1d03afc tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:32.953101 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5457835d-40ac-42c0-932d-23c1b1d03afc tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:32.953778 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5457835d-40ac-42c0-932d-23c1b1d03afc tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:32.954224 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5457835d-40ac-42c0-932d-23c1b1d03afc tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:32.954643 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5457835d-40ac-42c0-932d-23c1b1d03afc tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:32.962501 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4aff62f5-cf31-462f-a654-f29f34158b63 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:32.963110 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4aff62f5-cf31-462f-a654-f29f34158b63 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:32.970258 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4aff62f5-cf31-462f-a654-f29f34158b63 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:32.970739 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4aff62f5-cf31-462f-a654-f29f34158b63 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:32.971178 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4aff62f5-cf31-462f-a654-f29f34158b63 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:32.971888 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4aff62f5-cf31-462f-a654-f29f34158b63 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:32.972344 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4aff62f5-cf31-462f-a654-f29f34158b63 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:32.972765 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4aff62f5-cf31-462f-a654-f29f34158b63 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:33.097357 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5457835d-40ac-42c0-932d-23c1b1d03afc tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e9cc0ef8394696b127a32edd75e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8213db22feb041c196d02aaeac22d875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:33.106465 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5457835d-40ac-42c0-932d-23c1b1d03afc tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7" status: 200 len: 1319 microversion: 2.1 time: 0.165054 Sep 07 15:59:33.107374 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 270/525] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:32 2022] GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:59:33.130302 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-4aff62f5-cf31-462f-a654-f29f34158b63 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:33.137988 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4aff62f5-cf31-462f-a654-f29f34158b63 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1358 microversion: 2.1 time: 0.179209 Sep 07 15:59:33.138556 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 256/526] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:32 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:59:33.315320 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-44e229e3-bc10-499d-b879-2b0401cd0605 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:33.315846 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-44e229e3-bc10-499d-b879-2b0401cd0605 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:33.321636 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44e229e3-bc10-499d-b879-2b0401cd0605 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:33.322112 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44e229e3-bc10-499d-b879-2b0401cd0605 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:33.322538 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44e229e3-bc10-499d-b879-2b0401cd0605 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:33.323611 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44e229e3-bc10-499d-b879-2b0401cd0605 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:33.324058 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44e229e3-bc10-499d-b879-2b0401cd0605 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:33.324480 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44e229e3-bc10-499d-b879-2b0401cd0605 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:33.459134 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-44e229e3-bc10-499d-b879-2b0401cd0605 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:33.467110 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-44e229e3-bc10-499d-b879-2b0401cd0605 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:33.468555 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-44e229e3-bc10-499d-b879-2b0401cd0605 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:33.469696 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-44e229e3-bc10-499d-b879-2b0401cd0605 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1722 microversion: 2.20 time: 0.158365 Sep 07 15:59:33.470233 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 271/527] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:59:33 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:59:34.128834 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-841c7310-ac9d-4983-aaee-e020c4e06a8b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:34.129440 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-841c7310-ac9d-4983-aaee-e020c4e06a8b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 7807823a-6888-4edf-90cf-3f72de9017c7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:34.135925 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-841c7310-ac9d-4983-aaee-e020c4e06a8b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:34.136404 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-841c7310-ac9d-4983-aaee-e020c4e06a8b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:34.136831 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-841c7310-ac9d-4983-aaee-e020c4e06a8b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:34.137510 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-841c7310-ac9d-4983-aaee-e020c4e06a8b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:34.138462 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-841c7310-ac9d-4983-aaee-e020c4e06a8b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:34.138881 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-841c7310-ac9d-4983-aaee-e020c4e06a8b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:34.161810 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ba98fd91-4609-4db1-bf9f-6a1a1e943764 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:34.162413 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ba98fd91-4609-4db1-bf9f-6a1a1e943764 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:34.168215 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ba98fd91-4609-4db1-bf9f-6a1a1e943764 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:34.168691 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ba98fd91-4609-4db1-bf9f-6a1a1e943764 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:34.169118 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ba98fd91-4609-4db1-bf9f-6a1a1e943764 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:34.169797 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ba98fd91-4609-4db1-bf9f-6a1a1e943764 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:34.170240 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ba98fd91-4609-4db1-bf9f-6a1a1e943764 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:34.170664 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ba98fd91-4609-4db1-bf9f-6a1a1e943764 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:34.283883 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-841c7310-ac9d-4983-aaee-e020c4e06a8b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e9cc0ef8394696b127a32edd75e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8213db22feb041c196d02aaeac22d875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:34.292982 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-841c7310-ac9d-4983-aaee-e020c4e06a8b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7" status: 200 len: 1319 microversion: 2.1 time: 0.167886 Sep 07 15:59:34.299694 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 257/528] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:34 2022] GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:59:34.301996 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ba98fd91-4609-4db1-bf9f-6a1a1e943764 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:34.305351 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:59:34.310607 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ba98fd91-4609-4db1-bf9f-6a1a1e943764 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1548 microversion: 2.1 time: 0.152649 Sep 07 15:59:34.311158 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 272/529] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:34 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:59:34.333830 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-47fc7903-178c-4f0f-a339-0d2726d0c374 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:34.334438 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-47fc7903-178c-4f0f-a339-0d2726d0c374 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:34.340549 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-47fc7903-178c-4f0f-a339-0d2726d0c374 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:34.342021 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-47fc7903-178c-4f0f-a339-0d2726d0c374 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:34.342547 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-47fc7903-178c-4f0f-a339-0d2726d0c374 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:34.342747 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-47fc7903-178c-4f0f-a339-0d2726d0c374 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:34.343203 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-47fc7903-178c-4f0f-a339-0d2726d0c374 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:34.343656 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-47fc7903-178c-4f0f-a339-0d2726d0c374 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:34.479105 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-47fc7903-178c-4f0f-a339-0d2726d0c374 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:34.486782 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-47fc7903-178c-4f0f-a339-0d2726d0c374 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1548 microversion: 2.1 time: 0.156830 Sep 07 15:59:34.487337 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 258/530] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:34 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:59:34.495901 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-43425d6b-b245-446b-959d-8e55942ae659 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:34.496501 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-43425d6b-b245-446b-959d-8e55942ae659 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:34.502315 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43425d6b-b245-446b-959d-8e55942ae659 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:34.502792 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43425d6b-b245-446b-959d-8e55942ae659 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:34.503230 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43425d6b-b245-446b-959d-8e55942ae659 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:34.503931 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43425d6b-b245-446b-959d-8e55942ae659 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:34.504382 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43425d6b-b245-446b-959d-8e55942ae659 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:34.504939 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-43425d6b-b245-446b-959d-8e55942ae659 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:34.509002 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-86d0db5e-b780-46a5-966e-49ad37d07b58 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:34.515163 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-86d0db5e-b780-46a5-966e-49ad37d07b58 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:34.515953 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-86d0db5e-b780-46a5-966e-49ad37d07b58 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Searching by: {'deleted': False, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d'} {{(pid=120641) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 15:59:34.522792 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86d0db5e-b780-46a5-966e-49ad37d07b58 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:34.523267 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86d0db5e-b780-46a5-966e-49ad37d07b58 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:34.523755 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86d0db5e-b780-46a5-966e-49ad37d07b58 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:34.524469 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86d0db5e-b780-46a5-966e-49ad37d07b58 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:34.524910 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86d0db5e-b780-46a5-966e-49ad37d07b58 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:34.525326 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-86d0db5e-b780-46a5-966e-49ad37d07b58 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:34.623945 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.multi_cell_list [None req-86d0db5e-b780-46a5-966e-49ad37d07b58 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120641) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 15:59:34.650977 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-43425d6b-b245-446b-959d-8e55942ae659 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:34.663690 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-43425d6b-b245-446b-959d-8e55942ae659 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:34.665310 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-43425d6b-b245-446b-959d-8e55942ae659 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:34.666753 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-43425d6b-b245-446b-959d-8e55942ae659 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1722 microversion: 2.20 time: 0.174872 Sep 07 15:59:34.667375 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 273/531] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:59:34 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:59:34.741338 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-86d0db5e-b780-46a5-966e-49ad37d07b58 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.225373 Sep 07 15:59:34.741338 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 259/532] 10.222.0.17 () {58 vars in 1125 bytes} [Wed Sep 7 15:59:34 2022] GET /compute/v2.1/servers => generated 343 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:59:34.741540 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-a75e52dd-96fc-4038-81b3-4f1b87044ae1 req-75ee4a95-5ef0-4108-9965-2d1d307b05d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7807823a-6888-4edf-90cf-3f72de9017c7", "name": "network-vif-plugged", "status": "completed", "tag": "d4135853-bbb1-4003-986f-0834bf734654"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:59:34.742489 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a5e16084-569f-486c-b3d8-7309a4fdf178 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:34.743169 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a5e16084-569f-486c-b3d8-7309a4fdf178 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:34.749743 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5e16084-569f-486c-b3d8-7309a4fdf178 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:34.750548 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5e16084-569f-486c-b3d8-7309a4fdf178 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:34.750698 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5e16084-569f-486c-b3d8-7309a4fdf178 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:34.750914 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a75e52dd-96fc-4038-81b3-4f1b87044ae1 req-75ee4a95-5ef0-4108-9965-2d1d307b05d9 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:34.751341 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5e16084-569f-486c-b3d8-7309a4fdf178 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:34.751448 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a75e52dd-96fc-4038-81b3-4f1b87044ae1 req-75ee4a95-5ef0-4108-9965-2d1d307b05d9 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:34.751810 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-a75e52dd-96fc-4038-81b3-4f1b87044ae1 req-75ee4a95-5ef0-4108-9965-2d1d307b05d9 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:34.751913 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5e16084-569f-486c-b3d8-7309a4fdf178 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:34.752347 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5e16084-569f-486c-b3d8-7309a4fdf178 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:34.767789 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-a75e52dd-96fc-4038-81b3-4f1b87044ae1 req-75ee4a95-5ef0-4108-9965-2d1d307b05d9 service nova] Creating event network-vif-plugged:d4135853-bbb1-4003-986f-0834bf734654 for instance 7807823a-6888-4edf-90cf-3f72de9017c7 on hv-cinder-85331 Sep 07 15:59:34.776501 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-a75e52dd-96fc-4038-81b3-4f1b87044ae1 req-75ee4a95-5ef0-4108-9965-2d1d307b05d9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039927 Sep 07 15:59:34.777156 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 274/533] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 15:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:59:34.893788 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-a5e16084-569f-486c-b3d8-7309a4fdf178 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:34.902961 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a5e16084-569f-486c-b3d8-7309a4fdf178 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1548 microversion: 2.1 time: 0.164552 Sep 07 15:59:34.903527 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 260/534] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:34 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1548 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:59:35.315786 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0b20027b-3d1e-4f68-b925-8e19c7f2bd4b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:35.316472 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0b20027b-3d1e-4f68-b925-8e19c7f2bd4b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 7807823a-6888-4edf-90cf-3f72de9017c7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:35.322868 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b20027b-3d1e-4f68-b925-8e19c7f2bd4b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:35.323350 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b20027b-3d1e-4f68-b925-8e19c7f2bd4b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:35.323823 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b20027b-3d1e-4f68-b925-8e19c7f2bd4b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:35.324519 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b20027b-3d1e-4f68-b925-8e19c7f2bd4b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:35.324965 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b20027b-3d1e-4f68-b925-8e19c7f2bd4b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:35.325444 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0b20027b-3d1e-4f68-b925-8e19c7f2bd4b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:35.453828 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-0b20027b-3d1e-4f68-b925-8e19c7f2bd4b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e9cc0ef8394696b127a32edd75e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8213db22feb041c196d02aaeac22d875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:35.461287 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0b20027b-3d1e-4f68-b925-8e19c7f2bd4b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7" status: 200 len: 1319 microversion: 2.1 time: 0.149879 Sep 07 15:59:35.461833 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 275/535] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:35 2022] GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:59:35.695927 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6a5fa6a6-0b04-4c19-bccb-9f0a8695bbc9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:35.696656 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6a5fa6a6-0b04-4c19-bccb-9f0a8695bbc9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:35.703890 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a5fa6a6-0b04-4c19-bccb-9f0a8695bbc9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:35.704312 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a5fa6a6-0b04-4c19-bccb-9f0a8695bbc9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:35.704737 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a5fa6a6-0b04-4c19-bccb-9f0a8695bbc9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:35.705407 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a5fa6a6-0b04-4c19-bccb-9f0a8695bbc9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:35.705885 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a5fa6a6-0b04-4c19-bccb-9f0a8695bbc9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:35.706299 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a5fa6a6-0b04-4c19-bccb-9f0a8695bbc9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:35.839405 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-6a5fa6a6-0b04-4c19-bccb-9f0a8695bbc9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:35.849358 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-6a5fa6a6-0b04-4c19-bccb-9f0a8695bbc9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:35.851504 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-6a5fa6a6-0b04-4c19-bccb-9f0a8695bbc9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:35.852724 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6a5fa6a6-0b04-4c19-bccb-9f0a8695bbc9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1722 microversion: 2.20 time: 0.160865 Sep 07 15:59:35.853273 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 261/536] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:59:35 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:59:36.485914 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ccff71fc-d894-4b87-9f47-e1aac0c005fc tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:36.486676 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ccff71fc-d894-4b87-9f47-e1aac0c005fc tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 7807823a-6888-4edf-90cf-3f72de9017c7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:36.493097 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ccff71fc-d894-4b87-9f47-e1aac0c005fc tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:36.493583 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ccff71fc-d894-4b87-9f47-e1aac0c005fc tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:36.494016 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ccff71fc-d894-4b87-9f47-e1aac0c005fc tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:36.494705 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ccff71fc-d894-4b87-9f47-e1aac0c005fc tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:36.495151 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ccff71fc-d894-4b87-9f47-e1aac0c005fc tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:36.495652 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ccff71fc-d894-4b87-9f47-e1aac0c005fc tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:36.630567 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ccff71fc-d894-4b87-9f47-e1aac0c005fc tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e9cc0ef8394696b127a32edd75e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8213db22feb041c196d02aaeac22d875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:36.638462 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ccff71fc-d894-4b87-9f47-e1aac0c005fc tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7" status: 200 len: 1319 microversion: 2.1 time: 0.157517 Sep 07 15:59:36.639013 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 276/537] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:36 2022] GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:59:36.879495 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-350f4600-a8b3-4852-8057-1dc686c1aebc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:36.880071 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-350f4600-a8b3-4852-8057-1dc686c1aebc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:36.886423 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-350f4600-a8b3-4852-8057-1dc686c1aebc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:36.886904 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-350f4600-a8b3-4852-8057-1dc686c1aebc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:36.887332 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-350f4600-a8b3-4852-8057-1dc686c1aebc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:36.888045 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-350f4600-a8b3-4852-8057-1dc686c1aebc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:36.888494 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-350f4600-a8b3-4852-8057-1dc686c1aebc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:36.888910 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-350f4600-a8b3-4852-8057-1dc686c1aebc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:37.018678 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-350f4600-a8b3-4852-8057-1dc686c1aebc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:37.028152 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-350f4600-a8b3-4852-8057-1dc686c1aebc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:37.029711 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-350f4600-a8b3-4852-8057-1dc686c1aebc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:37.031215 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-350f4600-a8b3-4852-8057-1dc686c1aebc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1722 microversion: 2.20 time: 0.156071 Sep 07 15:59:37.034478 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 262/538] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:59:36 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:59:37.534157 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3e8a3d6e-713b-40aa-8988-3529fabfa690 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9eff6d69-019c-4757-9508-e9c4008deff6"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:59:37.536519 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3e8a3d6e-713b-40aa-8988-3529fabfa690 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:37.542453 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e8a3d6e-713b-40aa-8988-3529fabfa690 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:37.542929 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e8a3d6e-713b-40aa-8988-3529fabfa690 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:37.543363 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e8a3d6e-713b-40aa-8988-3529fabfa690 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:37.544075 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e8a3d6e-713b-40aa-8988-3529fabfa690 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:37.544526 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e8a3d6e-713b-40aa-8988-3529fabfa690 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:37.544948 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e8a3d6e-713b-40aa-8988-3529fabfa690 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:37.662095 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-63b83158-dc73-47ef-b147-0232a7e88447 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:37.662712 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-63b83158-dc73-47ef-b147-0232a7e88447 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 7807823a-6888-4edf-90cf-3f72de9017c7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:37.669234 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63b83158-dc73-47ef-b147-0232a7e88447 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:37.669763 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63b83158-dc73-47ef-b147-0232a7e88447 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:37.670196 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63b83158-dc73-47ef-b147-0232a7e88447 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:37.670889 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63b83158-dc73-47ef-b147-0232a7e88447 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:37.671341 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63b83158-dc73-47ef-b147-0232a7e88447 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:37.671804 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-63b83158-dc73-47ef-b147-0232a7e88447 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:37.805580 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-63b83158-dc73-47ef-b147-0232a7e88447 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e9cc0ef8394696b127a32edd75e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8213db22feb041c196d02aaeac22d875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:37.814365 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-63b83158-dc73-47ef-b147-0232a7e88447 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7" status: 200 len: 1507 microversion: 2.1 time: 0.156517 Sep 07 15:59:37.815403 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 263/539] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:37 2022] GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 15:59:38.047381 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3e8a3d6e-713b-40aa-8988-3529fabfa690 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "POST /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.517027 Sep 07 15:59:38.053422 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 277/540] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Sep 7 15:59:37 2022] POST /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33/os-volume_attachments => generated 194 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:59:38.057721 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9ab62009-b5ba-4bc5-af38-082f140093ce tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:38.058503 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9ab62009-b5ba-4bc5-af38-082f140093ce tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:38.067025 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9ab62009-b5ba-4bc5-af38-082f140093ce tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:38.067831 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9ab62009-b5ba-4bc5-af38-082f140093ce tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:38.068665 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9ab62009-b5ba-4bc5-af38-082f140093ce tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:38.069559 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9ab62009-b5ba-4bc5-af38-082f140093ce tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:38.070083 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9ab62009-b5ba-4bc5-af38-082f140093ce tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:38.070488 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9ab62009-b5ba-4bc5-af38-082f140093ce tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:38.241203 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-9ab62009-b5ba-4bc5-af38-082f140093ce tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:38.254009 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-9ab62009-b5ba-4bc5-af38-082f140093ce tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:38.255636 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-9ab62009-b5ba-4bc5-af38-082f140093ce tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:38.257054 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9ab62009-b5ba-4bc5-af38-082f140093ce tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1722 microversion: 2.20 time: 0.203592 Sep 07 15:59:38.257609 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 264/541] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:59:38 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1722 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 15:59:39.285392 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9ea4c3b6-57db-43e7-b874-0d6c7ecbd2e7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:39.286122 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9ea4c3b6-57db-43e7-b874-0d6c7ecbd2e7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:39.295958 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ea4c3b6-57db-43e7-b874-0d6c7ecbd2e7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:39.296469 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ea4c3b6-57db-43e7-b874-0d6c7ecbd2e7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:39.299603 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ea4c3b6-57db-43e7-b874-0d6c7ecbd2e7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:39.300688 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ea4c3b6-57db-43e7-b874-0d6c7ecbd2e7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:39.300920 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ea4c3b6-57db-43e7-b874-0d6c7ecbd2e7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:39.301350 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9ea4c3b6-57db-43e7-b874-0d6c7ecbd2e7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:39.440518 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9ea4c3b6-57db-43e7-b874-0d6c7ecbd2e7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:39.448823 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9ea4c3b6-57db-43e7-b874-0d6c7ecbd2e7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:39.450293 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9ea4c3b6-57db-43e7-b874-0d6c7ecbd2e7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:39.451498 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9ea4c3b6-57db-43e7-b874-0d6c7ecbd2e7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1722 microversion: 2.20 time: 0.174288 Sep 07 15:59:39.452086 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 278/542] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:59:39 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:59:40.481286 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b09094d9-048f-4de9-8024-4d50f0181867 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:40.481888 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b09094d9-048f-4de9-8024-4d50f0181867 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:40.489101 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b09094d9-048f-4de9-8024-4d50f0181867 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:40.489579 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b09094d9-048f-4de9-8024-4d50f0181867 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:40.490016 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b09094d9-048f-4de9-8024-4d50f0181867 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:40.490685 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b09094d9-048f-4de9-8024-4d50f0181867 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:40.491157 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b09094d9-048f-4de9-8024-4d50f0181867 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:40.491597 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b09094d9-048f-4de9-8024-4d50f0181867 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:40.621788 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-b09094d9-048f-4de9-8024-4d50f0181867 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:40.629712 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-b09094d9-048f-4de9-8024-4d50f0181867 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:40.631176 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-b09094d9-048f-4de9-8024-4d50f0181867 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:40.632372 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b09094d9-048f-4de9-8024-4d50f0181867 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1722 microversion: 2.20 time: 0.154947 Sep 07 15:59:40.632962 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 265/543] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:59:40 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:59:41.658362 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c354b097-1dfd-4287-a4f4-b13924dc6d3c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:41.658947 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c354b097-1dfd-4287-a4f4-b13924dc6d3c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:41.665759 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c354b097-1dfd-4287-a4f4-b13924dc6d3c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:41.666237 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c354b097-1dfd-4287-a4f4-b13924dc6d3c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:41.666677 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c354b097-1dfd-4287-a4f4-b13924dc6d3c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:41.667434 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c354b097-1dfd-4287-a4f4-b13924dc6d3c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:41.667908 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c354b097-1dfd-4287-a4f4-b13924dc6d3c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:41.668334 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c354b097-1dfd-4287-a4f4-b13924dc6d3c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:41.803302 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c354b097-1dfd-4287-a4f4-b13924dc6d3c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:41.811211 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c354b097-1dfd-4287-a4f4-b13924dc6d3c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:41.813260 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c354b097-1dfd-4287-a4f4-b13924dc6d3c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:41.814401 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c354b097-1dfd-4287-a4f4-b13924dc6d3c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1722 microversion: 2.20 time: 0.159985 Sep 07 15:59:41.814941 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 279/544] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:59:41 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:59:42.840091 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5d3e4c4f-5309-488c-b120-c5755c881272 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:42.840682 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5d3e4c4f-5309-488c-b120-c5755c881272 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:42.847790 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5d3e4c4f-5309-488c-b120-c5755c881272 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:42.848267 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5d3e4c4f-5309-488c-b120-c5755c881272 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:42.848698 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5d3e4c4f-5309-488c-b120-c5755c881272 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:42.849379 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5d3e4c4f-5309-488c-b120-c5755c881272 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:42.849982 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5d3e4c4f-5309-488c-b120-c5755c881272 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:42.850506 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5d3e4c4f-5309-488c-b120-c5755c881272 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:42.983294 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-5d3e4c4f-5309-488c-b120-c5755c881272 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:42.992341 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-5d3e4c4f-5309-488c-b120-c5755c881272 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:42.994093 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-5d3e4c4f-5309-488c-b120-c5755c881272 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:42.995443 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5d3e4c4f-5309-488c-b120-c5755c881272 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1722 microversion: 2.20 time: 0.159168 Sep 07 15:59:42.996028 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 266/545] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:59:42 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:59:44.021433 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5e9a5c76-7d9c-4e99-ad05-0cb40cf2479a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:44.022013 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5e9a5c76-7d9c-4e99-ad05-0cb40cf2479a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:44.028473 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5e9a5c76-7d9c-4e99-ad05-0cb40cf2479a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:44.028946 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5e9a5c76-7d9c-4e99-ad05-0cb40cf2479a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:44.029372 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5e9a5c76-7d9c-4e99-ad05-0cb40cf2479a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:44.030116 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5e9a5c76-7d9c-4e99-ad05-0cb40cf2479a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:44.030558 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5e9a5c76-7d9c-4e99-ad05-0cb40cf2479a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:44.031685 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5e9a5c76-7d9c-4e99-ad05-0cb40cf2479a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:44.160367 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5e9a5c76-7d9c-4e99-ad05-0cb40cf2479a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:44.168275 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5e9a5c76-7d9c-4e99-ad05-0cb40cf2479a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:44.169688 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5e9a5c76-7d9c-4e99-ad05-0cb40cf2479a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:44.170820 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5e9a5c76-7d9c-4e99-ad05-0cb40cf2479a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1722 microversion: 2.20 time: 0.153205 Sep 07 15:59:44.171362 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 280/546] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:59:44 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:59:45.195802 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-389833ba-2fef-4cf9-8eb9-686dad3cb20f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:45.196407 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-389833ba-2fef-4cf9-8eb9-686dad3cb20f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:45.198740 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:59:45.204131 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-389833ba-2fef-4cf9-8eb9-686dad3cb20f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:45.204611 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-389833ba-2fef-4cf9-8eb9-686dad3cb20f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:45.205486 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-389833ba-2fef-4cf9-8eb9-686dad3cb20f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:45.206206 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-389833ba-2fef-4cf9-8eb9-686dad3cb20f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:45.206649 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-389833ba-2fef-4cf9-8eb9-686dad3cb20f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:45.207070 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-389833ba-2fef-4cf9-8eb9-686dad3cb20f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:45.339210 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-389833ba-2fef-4cf9-8eb9-686dad3cb20f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:45.348971 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-389833ba-2fef-4cf9-8eb9-686dad3cb20f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:45.350651 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-389833ba-2fef-4cf9-8eb9-686dad3cb20f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:45.351827 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-389833ba-2fef-4cf9-8eb9-686dad3cb20f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1722 microversion: 2.20 time: 0.159936 Sep 07 15:59:45.352380 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 267/547] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:59:45 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:59:46.378828 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-85b891d1-7169-42be-8c99-e732d1685901 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:46.379427 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-85b891d1-7169-42be-8c99-e732d1685901 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:46.385843 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85b891d1-7169-42be-8c99-e732d1685901 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:46.386355 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85b891d1-7169-42be-8c99-e732d1685901 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:46.386786 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85b891d1-7169-42be-8c99-e732d1685901 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:46.387469 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85b891d1-7169-42be-8c99-e732d1685901 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:46.387948 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85b891d1-7169-42be-8c99-e732d1685901 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:46.388374 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85b891d1-7169-42be-8c99-e732d1685901 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:46.520546 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-85b891d1-7169-42be-8c99-e732d1685901 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:46.528545 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-85b891d1-7169-42be-8c99-e732d1685901 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:46.529958 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-85b891d1-7169-42be-8c99-e732d1685901 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:46.531633 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-85b891d1-7169-42be-8c99-e732d1685901 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1743 microversion: 2.20 time: 0.156785 Sep 07 15:59:46.532163 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 281/548] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:59:46 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:59:47.557811 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4934aecf-cb52-44cf-ae3d-1d9d5dc6a90f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:47.558433 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4934aecf-cb52-44cf-ae3d-1d9d5dc6a90f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:47.564807 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4934aecf-cb52-44cf-ae3d-1d9d5dc6a90f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:47.565289 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4934aecf-cb52-44cf-ae3d-1d9d5dc6a90f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:47.565721 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4934aecf-cb52-44cf-ae3d-1d9d5dc6a90f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:47.566404 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4934aecf-cb52-44cf-ae3d-1d9d5dc6a90f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:47.566853 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4934aecf-cb52-44cf-ae3d-1d9d5dc6a90f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:47.567285 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4934aecf-cb52-44cf-ae3d-1d9d5dc6a90f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:47.705019 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-4934aecf-cb52-44cf-ae3d-1d9d5dc6a90f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:47.713528 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-4934aecf-cb52-44cf-ae3d-1d9d5dc6a90f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:47.714986 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-4934aecf-cb52-44cf-ae3d-1d9d5dc6a90f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:47.716150 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4934aecf-cb52-44cf-ae3d-1d9d5dc6a90f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1743 microversion: 2.20 time: 0.162130 Sep 07 15:59:47.716685 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 268/549] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:59:47 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1743 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:59:47.854679 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-71bc31e4-a714-47ff-ab5a-3e6de0cf898b tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:47.855962 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-71bc31e4-a714-47ff-ab5a-3e6de0cf898b tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:47.865346 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71bc31e4-a714-47ff-ab5a-3e6de0cf898b tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:47.865346 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71bc31e4-a714-47ff-ab5a-3e6de0cf898b tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:47.865346 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71bc31e4-a714-47ff-ab5a-3e6de0cf898b tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:47.865346 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71bc31e4-a714-47ff-ab5a-3e6de0cf898b tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:47.865707 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71bc31e4-a714-47ff-ab5a-3e6de0cf898b tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:47.865707 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71bc31e4-a714-47ff-ab5a-3e6de0cf898b tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:47.996542 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-71bc31e4-a714-47ff-ab5a-3e6de0cf898b tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:48.004791 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-71bc31e4-a714-47ff-ab5a-3e6de0cf898b tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1594 microversion: 2.1 time: 0.154615 Sep 07 15:59:48.005352 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 282/550] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:47 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1594 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:59:48.745818 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-59f1aff7-2daf-46b8-bcc1-0d4e9b673c02 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:48.746428 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-59f1aff7-2daf-46b8-bcc1-0d4e9b673c02 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:48.752907 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-59f1aff7-2daf-46b8-bcc1-0d4e9b673c02 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:48.753392 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-59f1aff7-2daf-46b8-bcc1-0d4e9b673c02 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:48.753819 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-59f1aff7-2daf-46b8-bcc1-0d4e9b673c02 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:48.754694 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-59f1aff7-2daf-46b8-bcc1-0d4e9b673c02 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:48.755305 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-59f1aff7-2daf-46b8-bcc1-0d4e9b673c02 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:48.755756 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-59f1aff7-2daf-46b8-bcc1-0d4e9b673c02 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:48.770434 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=100 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:59:48.795664 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-b293d273-752f-4271-9ea0-3d3d5a2ee605 req-17e3c870-806f-40b6-a6c0-68d03a14e755 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "331c4dfb-7ee1-4585-bed9-2e65fa1f062a", "name": "network-vif-plugged", "status": "completed", "tag": "dcda231d-d2f5-41dc-b0c3-658f97c33345"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:59:48.806437 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-b293d273-752f-4271-9ea0-3d3d5a2ee605 req-17e3c870-806f-40b6-a6c0-68d03a14e755 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:48.806913 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-b293d273-752f-4271-9ea0-3d3d5a2ee605 req-17e3c870-806f-40b6-a6c0-68d03a14e755 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:48.807338 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-b293d273-752f-4271-9ea0-3d3d5a2ee605 req-17e3c870-806f-40b6-a6c0-68d03a14e755 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:48.822533 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-b293d273-752f-4271-9ea0-3d3d5a2ee605 req-17e3c870-806f-40b6-a6c0-68d03a14e755 service nova] Creating event network-vif-plugged:dcda231d-d2f5-41dc-b0c3-658f97c33345 for instance 331c4dfb-7ee1-4585-bed9-2e65fa1f062a on hv-cinder-85331 Sep 07 15:59:48.828583 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-b293d273-752f-4271-9ea0-3d3d5a2ee605 req-17e3c870-806f-40b6-a6c0-68d03a14e755 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036516 Sep 07 15:59:48.829233 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 283/551] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 15:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 15:59:48.899248 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-59f1aff7-2daf-46b8-bcc1-0d4e9b673c02 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:48.907504 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-59f1aff7-2daf-46b8-bcc1-0d4e9b673c02 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:48.908959 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-59f1aff7-2daf-46b8-bcc1-0d4e9b673c02 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:48.910112 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-59f1aff7-2daf-46b8-bcc1-0d4e9b673c02 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1743 microversion: 2.20 time: 0.171777 Sep 07 15:59:48.910673 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 269/552] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:59:48 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1743 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:59:49.935874 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-75cde672-a496-4c91-8437-197430de4f7e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:49.936558 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-75cde672-a496-4c91-8437-197430de4f7e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:49.943347 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75cde672-a496-4c91-8437-197430de4f7e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:49.943956 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75cde672-a496-4c91-8437-197430de4f7e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:49.944424 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75cde672-a496-4c91-8437-197430de4f7e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:49.945341 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75cde672-a496-4c91-8437-197430de4f7e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:49.945853 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75cde672-a496-4c91-8437-197430de4f7e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:49.946287 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-75cde672-a496-4c91-8437-197430de4f7e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:50.065318 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-571c41cd-e0e8-4faf-88dd-d61f525fae00 req-d7d231b5-c81c-4889-88fb-5f6f7b719cc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84743d24-2644-46a9-86a3-030706f2ec33", "tag": "62d356d3-a43c-486d-a45b-1855b53e8a1d"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:59:50.080946 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-571c41cd-e0e8-4faf-88dd-d61f525fae00 req-d7d231b5-c81c-4889-88fb-5f6f7b719cc2 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:50.081516 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-571c41cd-e0e8-4faf-88dd-d61f525fae00 req-d7d231b5-c81c-4889-88fb-5f6f7b719cc2 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:50.082009 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-571c41cd-e0e8-4faf-88dd-d61f525fae00 req-d7d231b5-c81c-4889-88fb-5f6f7b719cc2 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:50.101992 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-571c41cd-e0e8-4faf-88dd-d61f525fae00 req-d7d231b5-c81c-4889-88fb-5f6f7b719cc2 service nova] Creating event network-changed:62d356d3-a43c-486d-a45b-1855b53e8a1d for instance 84743d24-2644-46a9-86a3-030706f2ec33 on hv-cinder-85331 Sep 07 15:59:50.109596 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-571c41cd-e0e8-4faf-88dd-d61f525fae00 req-d7d231b5-c81c-4889-88fb-5f6f7b719cc2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051436 Sep 07 15:59:50.110523 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 270/553] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 15:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 15:59:50.130644 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-75cde672-a496-4c91-8437-197430de4f7e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:50.141055 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-75cde672-a496-4c91-8437-197430de4f7e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:50.143135 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-75cde672-a496-4c91-8437-197430de4f7e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:50.145181 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-75cde672-a496-4c91-8437-197430de4f7e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1743 microversion: 2.20 time: 0.213867 Sep 07 15:59:50.145861 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 284/554] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:59:49 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1743 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:59:51.144362 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-96d1876e-47db-4378-98f1-f1b332b9f156 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-528386023"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:59:51.144978 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-96d1876e-47db-4378-98f1-f1b332b9f156 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:51.151332 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-96d1876e-47db-4378-98f1-f1b332b9f156 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:51.151847 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-96d1876e-47db-4378-98f1-f1b332b9f156 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:51.152275 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-96d1876e-47db-4378-98f1-f1b332b9f156 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:51.152956 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-96d1876e-47db-4378-98f1-f1b332b9f156 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:51.153853 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-96d1876e-47db-4378-98f1-f1b332b9f156 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:51.154268 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-96d1876e-47db-4378-98f1-f1b332b9f156 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:51.174598 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e62e0add-99b3-4922-a58f-4a0a4e5062d5 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:51.175214 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e62e0add-99b3-4922-a58f-4a0a4e5062d5 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:51.185645 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e62e0add-99b3-4922-a58f-4a0a4e5062d5 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:51.186147 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e62e0add-99b3-4922-a58f-4a0a4e5062d5 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:51.186599 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e62e0add-99b3-4922-a58f-4a0a4e5062d5 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:51.188037 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e62e0add-99b3-4922-a58f-4a0a4e5062d5 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:51.188648 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e62e0add-99b3-4922-a58f-4a0a4e5062d5 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:51.189079 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e62e0add-99b3-4922-a58f-4a0a4e5062d5 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:51.303217 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.network.security_group_api [None req-96d1876e-47db-4378-98f1-f1b332b9f156 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Adding security group b179cd52-ee11-4033-87c3-79fa1bb4e12f to port 62d356d3-a43c-486d-a45b-1855b53e8a1d Sep 07 15:59:51.330734 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e62e0add-99b3-4922-a58f-4a0a4e5062d5 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:51.339054 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e62e0add-99b3-4922-a58f-4a0a4e5062d5 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:51.340545 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e62e0add-99b3-4922-a58f-4a0a4e5062d5 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:51.341757 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e62e0add-99b3-4922-a58f-4a0a4e5062d5 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1743 microversion: 2.20 time: 0.171044 Sep 07 15:59:51.342317 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 285/555] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:59:51 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1743 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:59:51.620923 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-96d1876e-47db-4378-98f1-f1b332b9f156 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "POST /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33/action" status: 202 len: 0 microversion: 2.1 time: 0.481912 Sep 07 15:59:51.621769 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 271/556] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Sep 7 15:59:51 2022] POST /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33/action => generated 0 bytes in 484 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 15:59:51.629021 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-8e390736-f915-4708-89f5-94a0fbaad2df req-32c297e8-f162-4afa-b3dc-1f45c1ee6898 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84743d24-2644-46a9-86a3-030706f2ec33", "tag": "62d356d3-a43c-486d-a45b-1855b53e8a1d"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 15:59:51.629398 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c98f0e0a-0f5d-49f2-95ad-c2ad6e18fcba tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:51.630043 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c98f0e0a-0f5d-49f2-95ad-c2ad6e18fcba tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:51.637191 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c98f0e0a-0f5d-49f2-95ad-c2ad6e18fcba tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:51.637889 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c98f0e0a-0f5d-49f2-95ad-c2ad6e18fcba tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:51.638662 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-8e390736-f915-4708-89f5-94a0fbaad2df req-32c297e8-f162-4afa-b3dc-1f45c1ee6898 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:51.638808 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c98f0e0a-0f5d-49f2-95ad-c2ad6e18fcba tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:51.639178 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-8e390736-f915-4708-89f5-94a0fbaad2df req-32c297e8-f162-4afa-b3dc-1f45c1ee6898 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:51.639572 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-8e390736-f915-4708-89f5-94a0fbaad2df req-32c297e8-f162-4afa-b3dc-1f45c1ee6898 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:51.639705 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c98f0e0a-0f5d-49f2-95ad-c2ad6e18fcba tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:51.640650 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c98f0e0a-0f5d-49f2-95ad-c2ad6e18fcba tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:51.641217 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c98f0e0a-0f5d-49f2-95ad-c2ad6e18fcba tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:51.654174 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-8e390736-f915-4708-89f5-94a0fbaad2df req-32c297e8-f162-4afa-b3dc-1f45c1ee6898 service nova] Creating event network-changed:62d356d3-a43c-486d-a45b-1855b53e8a1d for instance 84743d24-2644-46a9-86a3-030706f2ec33 on hv-cinder-85331 Sep 07 15:59:51.660890 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-8e390736-f915-4708-89f5-94a0fbaad2df req-32c297e8-f162-4afa-b3dc-1f45c1ee6898 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035442 Sep 07 15:59:51.662387 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 286/557] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 15:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 15:59:51.796926 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-c98f0e0a-0f5d-49f2-95ad-c2ad6e18fcba tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:51.815232 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c98f0e0a-0f5d-49f2-95ad-c2ad6e18fcba tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1759 microversion: 2.1 time: 0.189161 Sep 07 15:59:51.828171 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 272/558] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 15:59:51 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1759 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 15:59:52.368538 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-812a11a6-f761-4b0d-bb83-2d54a36e905d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:52.369226 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-812a11a6-f761-4b0d-bb83-2d54a36e905d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:52.371142 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=62 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:59:52.377150 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-812a11a6-f761-4b0d-bb83-2d54a36e905d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:52.377627 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-812a11a6-f761-4b0d-bb83-2d54a36e905d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:52.378058 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-812a11a6-f761-4b0d-bb83-2d54a36e905d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:52.378746 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-812a11a6-f761-4b0d-bb83-2d54a36e905d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:52.379193 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-812a11a6-f761-4b0d-bb83-2d54a36e905d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:52.379659 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-812a11a6-f761-4b0d-bb83-2d54a36e905d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:52.509019 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-812a11a6-f761-4b0d-bb83-2d54a36e905d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:52.517699 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-812a11a6-f761-4b0d-bb83-2d54a36e905d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:52.519126 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-812a11a6-f761-4b0d-bb83-2d54a36e905d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:52.520328 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-812a11a6-f761-4b0d-bb83-2d54a36e905d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1743 microversion: 2.20 time: 0.156504 Sep 07 15:59:52.520872 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 287/559] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:59:52 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:59:53.545548 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ed4bc15b-4cf6-4e3a-a418-b8992cfb1a0d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:53.546957 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ed4bc15b-4cf6-4e3a-a418-b8992cfb1a0d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:53.549864 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=64 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:59:53.555384 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ed4bc15b-4cf6-4e3a-a418-b8992cfb1a0d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:53.555925 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ed4bc15b-4cf6-4e3a-a418-b8992cfb1a0d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:53.556358 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ed4bc15b-4cf6-4e3a-a418-b8992cfb1a0d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:53.557046 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ed4bc15b-4cf6-4e3a-a418-b8992cfb1a0d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:53.557493 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ed4bc15b-4cf6-4e3a-a418-b8992cfb1a0d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:53.557909 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ed4bc15b-4cf6-4e3a-a418-b8992cfb1a0d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:53.686816 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-ed4bc15b-4cf6-4e3a-a418-b8992cfb1a0d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:53.694878 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-ed4bc15b-4cf6-4e3a-a418-b8992cfb1a0d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:53.696319 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-ed4bc15b-4cf6-4e3a-a418-b8992cfb1a0d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:53.697504 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ed4bc15b-4cf6-4e3a-a418-b8992cfb1a0d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1743 microversion: 2.20 time: 0.156014 Sep 07 15:59:53.698119 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 273/560] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:59:53 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1743 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:59:54.722924 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-96b76604-aed9-4b25-adba-2ef75feae59f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:54.723529 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-96b76604-aed9-4b25-adba-2ef75feae59f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:54.731019 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96b76604-aed9-4b25-adba-2ef75feae59f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:54.731501 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96b76604-aed9-4b25-adba-2ef75feae59f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:54.731960 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96b76604-aed9-4b25-adba-2ef75feae59f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:54.732660 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96b76604-aed9-4b25-adba-2ef75feae59f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:54.733106 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96b76604-aed9-4b25-adba-2ef75feae59f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:54.733528 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-96b76604-aed9-4b25-adba-2ef75feae59f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:54.859917 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-96b76604-aed9-4b25-adba-2ef75feae59f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:54.868002 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-96b76604-aed9-4b25-adba-2ef75feae59f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:54.869431 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-96b76604-aed9-4b25-adba-2ef75feae59f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:54.870580 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-96b76604-aed9-4b25-adba-2ef75feae59f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1743 microversion: 2.20 time: 0.151576 Sep 07 15:59:54.871121 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 288/561] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:59:54 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1743 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:59:55.895909 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a0048fb8-54a2-4ddb-91ed-1d279cc1cae9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:55.896513 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a0048fb8-54a2-4ddb-91ed-1d279cc1cae9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:55.902990 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a0048fb8-54a2-4ddb-91ed-1d279cc1cae9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:55.903473 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a0048fb8-54a2-4ddb-91ed-1d279cc1cae9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:55.903939 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a0048fb8-54a2-4ddb-91ed-1d279cc1cae9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:55.904624 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a0048fb8-54a2-4ddb-91ed-1d279cc1cae9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:55.905078 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a0048fb8-54a2-4ddb-91ed-1d279cc1cae9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:55.906082 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a0048fb8-54a2-4ddb-91ed-1d279cc1cae9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:56.028651 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-a0048fb8-54a2-4ddb-91ed-1d279cc1cae9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:56.037273 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-a0048fb8-54a2-4ddb-91ed-1d279cc1cae9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:56.038706 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-a0048fb8-54a2-4ddb-91ed-1d279cc1cae9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:56.039889 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a0048fb8-54a2-4ddb-91ed-1d279cc1cae9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1743 microversion: 2.20 time: 0.147836 Sep 07 15:59:56.040615 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 274/562] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:59:55 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1743 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:59:57.064663 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-48e5e940-af90-4e9e-b96d-3c7b7374405e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:57.065257 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-48e5e940-af90-4e9e-b96d-3c7b7374405e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:57.072113 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48e5e940-af90-4e9e-b96d-3c7b7374405e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:57.072583 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48e5e940-af90-4e9e-b96d-3c7b7374405e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:57.073013 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48e5e940-af90-4e9e-b96d-3c7b7374405e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:57.073682 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48e5e940-af90-4e9e-b96d-3c7b7374405e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:57.074125 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48e5e940-af90-4e9e-b96d-3c7b7374405e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:57.074542 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-48e5e940-af90-4e9e-b96d-3c7b7374405e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:57.209035 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-48e5e940-af90-4e9e-b96d-3c7b7374405e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:57.217269 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-48e5e940-af90-4e9e-b96d-3c7b7374405e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:57.218714 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-48e5e940-af90-4e9e-b96d-3c7b7374405e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:57.219881 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-48e5e940-af90-4e9e-b96d-3c7b7374405e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1743 microversion: 2.20 time: 0.159583 Sep 07 15:59:57.220431 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 289/563] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:59:57 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:59:58.244663 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-89b4a5ee-72b9-48e9-862e-552819f974ec tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:58.245269 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-89b4a5ee-72b9-48e9-862e-552819f974ec tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:58.252244 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89b4a5ee-72b9-48e9-862e-552819f974ec tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:58.252728 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89b4a5ee-72b9-48e9-862e-552819f974ec tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:58.253159 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89b4a5ee-72b9-48e9-862e-552819f974ec tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:58.253901 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89b4a5ee-72b9-48e9-862e-552819f974ec tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:58.254354 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89b4a5ee-72b9-48e9-862e-552819f974ec tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:58.254778 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89b4a5ee-72b9-48e9-862e-552819f974ec tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:58.389847 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-89b4a5ee-72b9-48e9-862e-552819f974ec tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:58.397967 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-89b4a5ee-72b9-48e9-862e-552819f974ec tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:58.399397 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-89b4a5ee-72b9-48e9-862e-552819f974ec tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:58.400573 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-89b4a5ee-72b9-48e9-862e-552819f974ec tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1743 microversion: 2.20 time: 0.159755 Sep 07 15:59:58.401298 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 275/564] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:59:58 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 15:59:59.425325 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5fa47baa-1181-46e3-84a3-f73639962b04 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 15:59:59.426604 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5fa47baa-1181-46e3-84a3-f73639962b04 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 15:59:59.433724 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5fa47baa-1181-46e3-84a3-f73639962b04 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:59.434284 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5fa47baa-1181-46e3-84a3-f73639962b04 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:59.434773 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5fa47baa-1181-46e3-84a3-f73639962b04 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:59.435502 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5fa47baa-1181-46e3-84a3-f73639962b04 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 15:59:59.435982 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5fa47baa-1181-46e3-84a3-f73639962b04 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 15:59:59.436404 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5fa47baa-1181-46e3-84a3-f73639962b04 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 15:59:59.463487 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:59:59.573494 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5fa47baa-1181-46e3-84a3-f73639962b04 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:59.582556 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5fa47baa-1181-46e3-84a3-f73639962b04 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:59.584472 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5fa47baa-1181-46e3-84a3-f73639962b04 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 15:59:59.585626 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5fa47baa-1181-46e3-84a3-f73639962b04 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1738 microversion: 2.20 time: 0.164710 Sep 07 15:59:59.586160 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 290/565] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 15:59:59 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1738 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:00:00.611623 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1f28f17c-4dea-456f-8181-193b3bad9189 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:00:00.612275 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1f28f17c-4dea-456f-8181-193b3bad9189 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:00.618752 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1f28f17c-4dea-456f-8181-193b3bad9189 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:00.619229 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1f28f17c-4dea-456f-8181-193b3bad9189 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:00.619693 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1f28f17c-4dea-456f-8181-193b3bad9189 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:00.620397 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1f28f17c-4dea-456f-8181-193b3bad9189 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:00.620843 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1f28f17c-4dea-456f-8181-193b3bad9189 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:00.621277 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1f28f17c-4dea-456f-8181-193b3bad9189 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:00.757557 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-1f28f17c-4dea-456f-8181-193b3bad9189 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:00.766517 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-1f28f17c-4dea-456f-8181-193b3bad9189 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:00.768498 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-1f28f17c-4dea-456f-8181-193b3bad9189 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:00.769660 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1f28f17c-4dea-456f-8181-193b3bad9189 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1738 microversion: 2.20 time: 0.162462 Sep 07 16:00:00.784356 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 276/566] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:00:00 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1738 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:00:01.802823 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-705d46a2-540c-4747-a0a2-3458dceb77d8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:00:01.803896 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-705d46a2-540c-4747-a0a2-3458dceb77d8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:01.811317 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-705d46a2-540c-4747-a0a2-3458dceb77d8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:01.812493 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-705d46a2-540c-4747-a0a2-3458dceb77d8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:01.812869 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-705d46a2-540c-4747-a0a2-3458dceb77d8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:01.813620 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-705d46a2-540c-4747-a0a2-3458dceb77d8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:01.814070 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-705d46a2-540c-4747-a0a2-3458dceb77d8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:01.814499 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-705d46a2-540c-4747-a0a2-3458dceb77d8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:01.943476 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-705d46a2-540c-4747-a0a2-3458dceb77d8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:01.951494 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-705d46a2-540c-4747-a0a2-3458dceb77d8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:01.953441 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-705d46a2-540c-4747-a0a2-3458dceb77d8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:01.954589 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-705d46a2-540c-4747-a0a2-3458dceb77d8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1738 microversion: 2.20 time: 0.157981 Sep 07 16:00:01.955139 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 291/567] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:00:01 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:00:02.980885 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3d4417c9-db53-44e9-8e15-9cbf6cc2375f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:00:02.982271 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3d4417c9-db53-44e9-8e15-9cbf6cc2375f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:02.990139 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3d4417c9-db53-44e9-8e15-9cbf6cc2375f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:02.991029 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3d4417c9-db53-44e9-8e15-9cbf6cc2375f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:02.991720 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3d4417c9-db53-44e9-8e15-9cbf6cc2375f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:02.992647 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3d4417c9-db53-44e9-8e15-9cbf6cc2375f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:02.993306 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3d4417c9-db53-44e9-8e15-9cbf6cc2375f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:02.994096 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3d4417c9-db53-44e9-8e15-9cbf6cc2375f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:03.131148 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-3d4417c9-db53-44e9-8e15-9cbf6cc2375f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:03.139328 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-3d4417c9-db53-44e9-8e15-9cbf6cc2375f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:03.140827 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-3d4417c9-db53-44e9-8e15-9cbf6cc2375f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:03.141982 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3d4417c9-db53-44e9-8e15-9cbf6cc2375f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1738 microversion: 2.20 time: 0.165063 Sep 07 16:00:03.142530 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 277/568] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:00:02 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1738 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:00:04.166839 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-55037a0d-de6b-4554-91a4-22e83f237d48 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:00:04.167477 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-55037a0d-de6b-4554-91a4-22e83f237d48 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:04.175030 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55037a0d-de6b-4554-91a4-22e83f237d48 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:04.175638 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55037a0d-de6b-4554-91a4-22e83f237d48 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:04.176160 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55037a0d-de6b-4554-91a4-22e83f237d48 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:04.176861 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55037a0d-de6b-4554-91a4-22e83f237d48 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:04.177316 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55037a0d-de6b-4554-91a4-22e83f237d48 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:04.177811 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55037a0d-de6b-4554-91a4-22e83f237d48 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:04.314364 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-55037a0d-de6b-4554-91a4-22e83f237d48 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:04.322865 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-55037a0d-de6b-4554-91a4-22e83f237d48 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:04.324785 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-55037a0d-de6b-4554-91a4-22e83f237d48 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:04.326379 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-55037a0d-de6b-4554-91a4-22e83f237d48 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1738 microversion: 2.20 time: 0.163087 Sep 07 16:00:04.328532 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 292/569] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:00:04 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1738 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:00:05.353446 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-37a38f83-83da-414d-b731-05ce25a0f329 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:00:05.354049 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-37a38f83-83da-414d-b731-05ce25a0f329 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:05.360569 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37a38f83-83da-414d-b731-05ce25a0f329 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:05.361050 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37a38f83-83da-414d-b731-05ce25a0f329 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:05.361483 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37a38f83-83da-414d-b731-05ce25a0f329 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:05.362167 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37a38f83-83da-414d-b731-05ce25a0f329 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:05.362621 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37a38f83-83da-414d-b731-05ce25a0f329 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:05.363047 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-37a38f83-83da-414d-b731-05ce25a0f329 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:05.496586 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-37a38f83-83da-414d-b731-05ce25a0f329 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:05.506821 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-37a38f83-83da-414d-b731-05ce25a0f329 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:05.508417 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-37a38f83-83da-414d-b731-05ce25a0f329 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:05.509660 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-37a38f83-83da-414d-b731-05ce25a0f329 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1738 microversion: 2.20 time: 0.160255 Sep 07 16:00:05.510194 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 278/570] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:00:05 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:00:06.534737 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7f18d2e2-fea5-46e5-8dd4-43fbe0b2533c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:00:06.535427 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7f18d2e2-fea5-46e5-8dd4-43fbe0b2533c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:06.542791 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f18d2e2-fea5-46e5-8dd4-43fbe0b2533c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:06.543283 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f18d2e2-fea5-46e5-8dd4-43fbe0b2533c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:06.543776 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f18d2e2-fea5-46e5-8dd4-43fbe0b2533c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:06.544666 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f18d2e2-fea5-46e5-8dd4-43fbe0b2533c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:06.545277 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f18d2e2-fea5-46e5-8dd4-43fbe0b2533c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:06.546209 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f18d2e2-fea5-46e5-8dd4-43fbe0b2533c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:06.682455 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7f18d2e2-fea5-46e5-8dd4-43fbe0b2533c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:06.691612 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7f18d2e2-fea5-46e5-8dd4-43fbe0b2533c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:06.693121 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7f18d2e2-fea5-46e5-8dd4-43fbe0b2533c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:06.694320 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7f18d2e2-fea5-46e5-8dd4-43fbe0b2533c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1738 microversion: 2.20 time: 0.163557 Sep 07 16:00:06.694904 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 293/571] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:00:06 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1738 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:00:07.720994 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-70efd420-ec50-4176-b1b3-6ca32436f1f7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:00:07.721731 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-70efd420-ec50-4176-b1b3-6ca32436f1f7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:07.731773 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70efd420-ec50-4176-b1b3-6ca32436f1f7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:07.732338 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70efd420-ec50-4176-b1b3-6ca32436f1f7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:07.733001 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70efd420-ec50-4176-b1b3-6ca32436f1f7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:07.734304 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70efd420-ec50-4176-b1b3-6ca32436f1f7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:07.734763 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70efd420-ec50-4176-b1b3-6ca32436f1f7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:07.735225 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70efd420-ec50-4176-b1b3-6ca32436f1f7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:07.883691 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-70efd420-ec50-4176-b1b3-6ca32436f1f7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:07.892789 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-70efd420-ec50-4176-b1b3-6ca32436f1f7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:07.894211 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-70efd420-ec50-4176-b1b3-6ca32436f1f7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:07.895351 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-70efd420-ec50-4176-b1b3-6ca32436f1f7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1738 microversion: 2.20 time: 0.179014 Sep 07 16:00:07.895935 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 279/572] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:00:07 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1738 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:00:08.922568 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-22c646fd-03a3-479d-828c-996d788753bc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:00:08.923232 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-22c646fd-03a3-479d-828c-996d788753bc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:08.929501 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22c646fd-03a3-479d-828c-996d788753bc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:08.929995 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22c646fd-03a3-479d-828c-996d788753bc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:08.930431 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22c646fd-03a3-479d-828c-996d788753bc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:08.931125 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22c646fd-03a3-479d-828c-996d788753bc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:08.931605 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22c646fd-03a3-479d-828c-996d788753bc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:08.932035 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22c646fd-03a3-479d-828c-996d788753bc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:09.107340 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-22c646fd-03a3-479d-828c-996d788753bc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:09.116530 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-22c646fd-03a3-479d-828c-996d788753bc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:09.117946 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-22c646fd-03a3-479d-828c-996d788753bc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:09.119088 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-22c646fd-03a3-479d-828c-996d788753bc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1738 microversion: 2.20 time: 0.200963 Sep 07 16:00:09.119651 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 294/573] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:00:08 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1738 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:00:10.144609 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4de6fe10-af20-4083-9746-520882f60b44 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:00:10.145271 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4de6fe10-af20-4083-9746-520882f60b44 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:10.151856 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4de6fe10-af20-4083-9746-520882f60b44 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:10.152335 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4de6fe10-af20-4083-9746-520882f60b44 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:10.152771 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4de6fe10-af20-4083-9746-520882f60b44 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:10.153467 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4de6fe10-af20-4083-9746-520882f60b44 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:10.153915 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4de6fe10-af20-4083-9746-520882f60b44 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:10.154333 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4de6fe10-af20-4083-9746-520882f60b44 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:10.304450 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-4de6fe10-af20-4083-9746-520882f60b44 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:10.314489 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-4de6fe10-af20-4083-9746-520882f60b44 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:10.316706 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-4de6fe10-af20-4083-9746-520882f60b44 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:10.318342 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4de6fe10-af20-4083-9746-520882f60b44 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1738 microversion: 2.20 time: 0.177414 Sep 07 16:00:10.319073 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 280/574] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:00:10 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1738 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:00:11.347561 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-94d7d5ec-3440-4393-a43f-f980d7fff0c2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:00:11.348258 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-94d7d5ec-3440-4393-a43f-f980d7fff0c2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:11.355081 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94d7d5ec-3440-4393-a43f-f980d7fff0c2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:11.355606 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94d7d5ec-3440-4393-a43f-f980d7fff0c2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:11.356054 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94d7d5ec-3440-4393-a43f-f980d7fff0c2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:11.356743 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94d7d5ec-3440-4393-a43f-f980d7fff0c2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:11.357199 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94d7d5ec-3440-4393-a43f-f980d7fff0c2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:11.357624 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-94d7d5ec-3440-4393-a43f-f980d7fff0c2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:11.495645 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-94d7d5ec-3440-4393-a43f-f980d7fff0c2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:11.507723 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-94d7d5ec-3440-4393-a43f-f980d7fff0c2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:11.509370 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-94d7d5ec-3440-4393-a43f-f980d7fff0c2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:11.510522 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-94d7d5ec-3440-4393-a43f-f980d7fff0c2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1738 microversion: 2.20 time: 0.166873 Sep 07 16:00:11.511054 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 295/575] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:00:11 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1738 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:00:12.539026 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a3b36359-2cab-4a8d-b962-60b7955f5e87 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:00:12.539781 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a3b36359-2cab-4a8d-b962-60b7955f5e87 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:12.547130 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3b36359-2cab-4a8d-b962-60b7955f5e87 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:12.547711 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3b36359-2cab-4a8d-b962-60b7955f5e87 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:12.548335 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3b36359-2cab-4a8d-b962-60b7955f5e87 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:12.549080 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3b36359-2cab-4a8d-b962-60b7955f5e87 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:12.549711 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3b36359-2cab-4a8d-b962-60b7955f5e87 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:12.550149 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3b36359-2cab-4a8d-b962-60b7955f5e87 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:12.712364 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-a3b36359-2cab-4a8d-b962-60b7955f5e87 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:12.721399 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-a3b36359-2cab-4a8d-b962-60b7955f5e87 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:12.723004 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-a3b36359-2cab-4a8d-b962-60b7955f5e87 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:12.724221 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a3b36359-2cab-4a8d-b962-60b7955f5e87 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1738 microversion: 2.20 time: 0.190882 Sep 07 16:00:12.724777 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 281/576] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:00:12 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1738 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:00:13.754491 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f9d4f4ad-b353-42cc-a21e-7c91038fc8a7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:00:13.755039 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f9d4f4ad-b353-42cc-a21e-7c91038fc8a7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:13.762679 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9d4f4ad-b353-42cc-a21e-7c91038fc8a7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:13.763348 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9d4f4ad-b353-42cc-a21e-7c91038fc8a7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:13.763980 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9d4f4ad-b353-42cc-a21e-7c91038fc8a7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:13.764832 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9d4f4ad-b353-42cc-a21e-7c91038fc8a7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:13.765520 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9d4f4ad-b353-42cc-a21e-7c91038fc8a7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:13.766102 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f9d4f4ad-b353-42cc-a21e-7c91038fc8a7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:13.908326 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f9d4f4ad-b353-42cc-a21e-7c91038fc8a7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:13.917717 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f9d4f4ad-b353-42cc-a21e-7c91038fc8a7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:13.919736 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f9d4f4ad-b353-42cc-a21e-7c91038fc8a7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:13.921633 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f9d4f4ad-b353-42cc-a21e-7c91038fc8a7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1738 microversion: 2.20 time: 0.171176 Sep 07 16:00:13.922676 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 296/577] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:00:13 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1738 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:00:14.948764 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a00c6904-eb3c-421e-beb8-52b7c9d18bdf tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:00:14.951117 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a00c6904-eb3c-421e-beb8-52b7c9d18bdf tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:14.972965 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a00c6904-eb3c-421e-beb8-52b7c9d18bdf tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:14.973909 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a00c6904-eb3c-421e-beb8-52b7c9d18bdf tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:14.975880 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a00c6904-eb3c-421e-beb8-52b7c9d18bdf tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:14.976909 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a00c6904-eb3c-421e-beb8-52b7c9d18bdf tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:14.977465 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a00c6904-eb3c-421e-beb8-52b7c9d18bdf tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:14.978163 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a00c6904-eb3c-421e-beb8-52b7c9d18bdf tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:15.147141 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-a00c6904-eb3c-421e-beb8-52b7c9d18bdf tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:15.165165 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-a00c6904-eb3c-421e-beb8-52b7c9d18bdf tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:15.167012 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-a00c6904-eb3c-421e-beb8-52b7c9d18bdf tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:15.168398 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a00c6904-eb3c-421e-beb8-52b7c9d18bdf tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1738 microversion: 2.20 time: 0.223684 Sep 07 16:00:15.169326 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 282/578] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:00:14 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1738 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:00:16.197830 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7164c9b6-fe4b-4f17-8c09-0547ba7c3945 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:00:16.198441 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7164c9b6-fe4b-4f17-8c09-0547ba7c3945 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:16.206893 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7164c9b6-fe4b-4f17-8c09-0547ba7c3945 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:16.207383 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7164c9b6-fe4b-4f17-8c09-0547ba7c3945 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:16.207838 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7164c9b6-fe4b-4f17-8c09-0547ba7c3945 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:16.208680 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7164c9b6-fe4b-4f17-8c09-0547ba7c3945 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:16.209131 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7164c9b6-fe4b-4f17-8c09-0547ba7c3945 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:16.209552 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7164c9b6-fe4b-4f17-8c09-0547ba7c3945 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:16.386112 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7164c9b6-fe4b-4f17-8c09-0547ba7c3945 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:16.397116 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7164c9b6-fe4b-4f17-8c09-0547ba7c3945 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:16.398598 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7164c9b6-fe4b-4f17-8c09-0547ba7c3945 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:16.400175 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7164c9b6-fe4b-4f17-8c09-0547ba7c3945 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1738 microversion: 2.20 time: 0.206614 Sep 07 16:00:16.400726 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 297/579] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:00:16 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1738 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:00:17.426625 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d99f2b7d-d73f-4181-90ec-bacfd115aaf4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:00:17.427317 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d99f2b7d-d73f-4181-90ec-bacfd115aaf4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:17.439586 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d99f2b7d-d73f-4181-90ec-bacfd115aaf4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:17.439586 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d99f2b7d-d73f-4181-90ec-bacfd115aaf4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:17.439586 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d99f2b7d-d73f-4181-90ec-bacfd115aaf4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:17.440001 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d99f2b7d-d73f-4181-90ec-bacfd115aaf4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:17.440222 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d99f2b7d-d73f-4181-90ec-bacfd115aaf4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:17.440618 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d99f2b7d-d73f-4181-90ec-bacfd115aaf4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:17.604328 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-d99f2b7d-d73f-4181-90ec-bacfd115aaf4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:17.622217 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-d99f2b7d-d73f-4181-90ec-bacfd115aaf4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:17.623680 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-d99f2b7d-d73f-4181-90ec-bacfd115aaf4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:17.624892 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d99f2b7d-d73f-4181-90ec-bacfd115aaf4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1738 microversion: 2.20 time: 0.202385 Sep 07 16:00:17.625432 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 283/580] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:00:17 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1738 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:00:18.610757 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c87a0b46-c476-4860-a674-43b6e028fc94 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7eab509d-cc4a-4e17-bbed-5407915bd780", "device": "/dev/sdb"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:00:18.613616 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c87a0b46-c476-4860-a674-43b6e028fc94 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 7807823a-6888-4edf-90cf-3f72de9017c7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:18.620075 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c87a0b46-c476-4860-a674-43b6e028fc94 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:18.620561 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c87a0b46-c476-4860-a674-43b6e028fc94 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:18.620997 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c87a0b46-c476-4860-a674-43b6e028fc94 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:18.621690 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c87a0b46-c476-4860-a674-43b6e028fc94 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:18.622139 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c87a0b46-c476-4860-a674-43b6e028fc94 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:18.622570 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c87a0b46-c476-4860-a674-43b6e028fc94 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:18.656435 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-52d41f92-d62e-4c3e-aaff-17c8ad542c54 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:00:18.657114 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-52d41f92-d62e-4c3e-aaff-17c8ad542c54 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:18.664219 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-52d41f92-d62e-4c3e-aaff-17c8ad542c54 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:18.664797 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-52d41f92-d62e-4c3e-aaff-17c8ad542c54 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:18.665232 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-52d41f92-d62e-4c3e-aaff-17c8ad542c54 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:18.665927 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-52d41f92-d62e-4c3e-aaff-17c8ad542c54 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:18.666371 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-52d41f92-d62e-4c3e-aaff-17c8ad542c54 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:18.666874 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-52d41f92-d62e-4c3e-aaff-17c8ad542c54 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:18.796956 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-52d41f92-d62e-4c3e-aaff-17c8ad542c54 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:18.799178 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=86 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:18.806902 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-52d41f92-d62e-4c3e-aaff-17c8ad542c54 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:18.808353 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-52d41f92-d62e-4c3e-aaff-17c8ad542c54 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:18.809507 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-52d41f92-d62e-4c3e-aaff-17c8ad542c54 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1738 microversion: 2.20 time: 0.157259 Sep 07 16:00:18.810051 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 284/581] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:00:18 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:00:18.899651 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c87a0b46-c476-4860-a674-43b6e028fc94 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "POST /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.293065 Sep 07 16:00:18.900446 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 298/582] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Sep 7 16:00:18 2022] POST /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:00:19.834678 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-83fa8e0c-2959-4fd0-80ef-2d6132f30e3f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:00:19.835242 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-83fa8e0c-2959-4fd0-80ef-2d6132f30e3f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:19.841609 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-83fa8e0c-2959-4fd0-80ef-2d6132f30e3f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:19.842093 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-83fa8e0c-2959-4fd0-80ef-2d6132f30e3f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:19.842528 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-83fa8e0c-2959-4fd0-80ef-2d6132f30e3f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:19.843217 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-83fa8e0c-2959-4fd0-80ef-2d6132f30e3f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:19.843719 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-83fa8e0c-2959-4fd0-80ef-2d6132f30e3f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:19.844128 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-83fa8e0c-2959-4fd0-80ef-2d6132f30e3f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:19.984132 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-83fa8e0c-2959-4fd0-80ef-2d6132f30e3f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:19.993725 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-83fa8e0c-2959-4fd0-80ef-2d6132f30e3f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:19.995686 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-83fa8e0c-2959-4fd0-80ef-2d6132f30e3f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:19.997128 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-83fa8e0c-2959-4fd0-80ef-2d6132f30e3f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1720 microversion: 2.20 time: 0.166536 Sep 07 16:00:19.997802 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 285/583] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:00:19 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1720 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:00:21.025187 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-55d1db0c-8394-42c6-bd2a-a70c4f98c4a4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:00:21.025872 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-55d1db0c-8394-42c6-bd2a-a70c4f98c4a4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:21.032404 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55d1db0c-8394-42c6-bd2a-a70c4f98c4a4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:21.032876 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55d1db0c-8394-42c6-bd2a-a70c4f98c4a4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:21.033303 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55d1db0c-8394-42c6-bd2a-a70c4f98c4a4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:21.033978 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55d1db0c-8394-42c6-bd2a-a70c4f98c4a4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:21.034419 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55d1db0c-8394-42c6-bd2a-a70c4f98c4a4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:21.034840 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-55d1db0c-8394-42c6-bd2a-a70c4f98c4a4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:21.168803 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-55d1db0c-8394-42c6-bd2a-a70c4f98c4a4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:21.177127 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-55d1db0c-8394-42c6-bd2a-a70c4f98c4a4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:21.178564 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-55d1db0c-8394-42c6-bd2a-a70c4f98c4a4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:21.179751 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-55d1db0c-8394-42c6-bd2a-a70c4f98c4a4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1720 microversion: 2.20 time: 0.158784 Sep 07 16:00:21.180295 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 299/584] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:00:21 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:00:22.206346 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-117eb035-adda-460e-9c5f-c3944663950a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:00:22.206997 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-117eb035-adda-460e-9c5f-c3944663950a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:22.214394 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-117eb035-adda-460e-9c5f-c3944663950a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:22.214885 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-117eb035-adda-460e-9c5f-c3944663950a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:22.215325 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-117eb035-adda-460e-9c5f-c3944663950a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:22.216038 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-117eb035-adda-460e-9c5f-c3944663950a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:22.216703 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-117eb035-adda-460e-9c5f-c3944663950a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:22.216887 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-117eb035-adda-460e-9c5f-c3944663950a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:22.349732 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-117eb035-adda-460e-9c5f-c3944663950a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:22.358199 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-117eb035-adda-460e-9c5f-c3944663950a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:22.359648 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-117eb035-adda-460e-9c5f-c3944663950a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:22.360795 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-117eb035-adda-460e-9c5f-c3944663950a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1723 microversion: 2.20 time: 0.159609 Sep 07 16:00:22.361342 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 286/585] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:00:22 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:00:22.385204 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-16320b57-b900-4005-8b89-64b784806d13 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "08fc30f7-7c9f-49dd-ad34-052fd90c0204"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:00:22.387598 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-16320b57-b900-4005-8b89-64b784806d13 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:22.390509 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=26 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:22.395951 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-16320b57-b900-4005-8b89-64b784806d13 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:22.396428 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-16320b57-b900-4005-8b89-64b784806d13 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:22.396863 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-16320b57-b900-4005-8b89-64b784806d13 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:22.397548 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-16320b57-b900-4005-8b89-64b784806d13 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:22.397999 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-16320b57-b900-4005-8b89-64b784806d13 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:22.398420 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-16320b57-b900-4005-8b89-64b784806d13 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:22.681013 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-16320b57-b900-4005-8b89-64b784806d13 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "POST /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.299379 Sep 07 16:00:22.681743 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 300/586] 10.222.0.17 () {62 vars in 1364 bytes} [Wed Sep 7 16:00:22 2022] POST /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a/os-volume_attachments => generated 188 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 16:00:22.808454 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6a65faf6-054d-4791-9d24-0172f6815fd4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:00:22.809086 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6a65faf6-054d-4791-9d24-0172f6815fd4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:22.814908 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a65faf6-054d-4791-9d24-0172f6815fd4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:22.815363 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a65faf6-054d-4791-9d24-0172f6815fd4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:22.815826 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a65faf6-054d-4791-9d24-0172f6815fd4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:22.816500 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a65faf6-054d-4791-9d24-0172f6815fd4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:22.816952 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a65faf6-054d-4791-9d24-0172f6815fd4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:22.817367 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a65faf6-054d-4791-9d24-0172f6815fd4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:22.859532 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6a65faf6-054d-4791-9d24-0172f6815fd4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120641) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 07 16:00:22.925342 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6a65faf6-054d-4791-9d24-0172f6815fd4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "POST /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a/action" status: 202 len: 0 microversion: 2.20 time: 0.120669 Sep 07 16:00:22.926036 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 287/587] 10.222.0.17 () {62 vars in 1319 bytes} [Wed Sep 7 16:00:22 2022] POST /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 16:00:22.934180 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3800295a-7cf5-47c9-b46d-b60e178bcee5 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:00:22.934785 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3800295a-7cf5-47c9-b46d-b60e178bcee5 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:22.941762 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3800295a-7cf5-47c9-b46d-b60e178bcee5 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:22.942260 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3800295a-7cf5-47c9-b46d-b60e178bcee5 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:22.942740 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3800295a-7cf5-47c9-b46d-b60e178bcee5 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:22.943645 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3800295a-7cf5-47c9-b46d-b60e178bcee5 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:22.944103 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3800295a-7cf5-47c9-b46d-b60e178bcee5 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:22.944527 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3800295a-7cf5-47c9-b46d-b60e178bcee5 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:23.074671 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3800295a-7cf5-47c9-b46d-b60e178bcee5 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:23.084416 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3800295a-7cf5-47c9-b46d-b60e178bcee5 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:23.085969 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3800295a-7cf5-47c9-b46d-b60e178bcee5 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:23.086991 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3800295a-7cf5-47c9-b46d-b60e178bcee5 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1749 microversion: 2.20 time: 0.156763 Sep 07 16:00:23.087538 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 301/588] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:00:22 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1749 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:00:23.317820 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-f8e574d9-9139-40f9-a346-6e610bcc2c5a req-875d99c2-fd2c-4693-a6a2-204a923f6b83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "331c4dfb-7ee1-4585-bed9-2e65fa1f062a", "name": "network-vif-unplugged", "status": "completed", "tag": "dcda231d-d2f5-41dc-b0c3-658f97c33345"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:00:23.329135 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-f8e574d9-9139-40f9-a346-6e610bcc2c5a req-875d99c2-fd2c-4693-a6a2-204a923f6b83 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:23.329527 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-f8e574d9-9139-40f9-a346-6e610bcc2c5a req-875d99c2-fd2c-4693-a6a2-204a923f6b83 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:23.329983 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-f8e574d9-9139-40f9-a346-6e610bcc2c5a req-875d99c2-fd2c-4693-a6a2-204a923f6b83 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:23.341706 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.compute.server_external_events [req-f8e574d9-9139-40f9-a346-6e610bcc2c5a req-875d99c2-fd2c-4693-a6a2-204a923f6b83 service nova] Unable to find a host for instance 331c4dfb-7ee1-4585-bed9-2e65fa1f062a. Dropping event network-vif-unplugged {{(pid=120641) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 07 16:00:23.343928 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-f8e574d9-9139-40f9-a346-6e610bcc2c5a req-875d99c2-fd2c-4693-a6a2-204a923f6b83 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030203 Sep 07 16:00:23.344634 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 288/589] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 07 16:00:24.113254 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c2424ff8-1379-4d36-8131-e0bd8f736edb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:00:24.113922 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c2424ff8-1379-4d36-8131-e0bd8f736edb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:24.120309 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2424ff8-1379-4d36-8131-e0bd8f736edb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:24.120792 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2424ff8-1379-4d36-8131-e0bd8f736edb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:24.121228 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2424ff8-1379-4d36-8131-e0bd8f736edb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:24.121914 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2424ff8-1379-4d36-8131-e0bd8f736edb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:24.122365 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2424ff8-1379-4d36-8131-e0bd8f736edb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:24.122900 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c2424ff8-1379-4d36-8131-e0bd8f736edb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:24.253992 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c2424ff8-1379-4d36-8131-e0bd8f736edb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:24.258073 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:24.264442 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c2424ff8-1379-4d36-8131-e0bd8f736edb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:24.265887 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c2424ff8-1379-4d36-8131-e0bd8f736edb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:24.267040 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c2424ff8-1379-4d36-8131-e0bd8f736edb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1751 microversion: 2.20 time: 0.157721 Sep 07 16:00:24.267868 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 302/590] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:00:24 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:00:25.292315 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ad222a2f-8ead-40a4-9d80-62ad1b26a530 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:00:25.292934 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ad222a2f-8ead-40a4-9d80-62ad1b26a530 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:25.296080 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:25.303387 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad222a2f-8ead-40a4-9d80-62ad1b26a530 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:25.303911 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad222a2f-8ead-40a4-9d80-62ad1b26a530 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:25.304359 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad222a2f-8ead-40a4-9d80-62ad1b26a530 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:25.305446 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad222a2f-8ead-40a4-9d80-62ad1b26a530 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:25.305913 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad222a2f-8ead-40a4-9d80-62ad1b26a530 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:25.306344 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad222a2f-8ead-40a4-9d80-62ad1b26a530 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:25.435477 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-ad222a2f-8ead-40a4-9d80-62ad1b26a530 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:25.443785 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-ad222a2f-8ead-40a4-9d80-62ad1b26a530 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:25.445190 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-ad222a2f-8ead-40a4-9d80-62ad1b26a530 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:25.446318 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ad222a2f-8ead-40a4-9d80-62ad1b26a530 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1751 microversion: 2.20 time: 0.157916 Sep 07 16:00:25.446868 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 289/591] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:00:25 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:00:26.472605 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4386c5c9-6017-409e-8136-500191971c9a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:00:26.473197 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4386c5c9-6017-409e-8136-500191971c9a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:26.481270 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4386c5c9-6017-409e-8136-500191971c9a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:26.481752 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4386c5c9-6017-409e-8136-500191971c9a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:26.482179 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4386c5c9-6017-409e-8136-500191971c9a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:26.483435 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4386c5c9-6017-409e-8136-500191971c9a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:26.483910 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4386c5c9-6017-409e-8136-500191971c9a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:26.484325 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4386c5c9-6017-409e-8136-500191971c9a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:26.616364 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-4386c5c9-6017-409e-8136-500191971c9a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:26.625092 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-4386c5c9-6017-409e-8136-500191971c9a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:26.626532 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-4386c5c9-6017-409e-8136-500191971c9a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:26.627716 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4386c5c9-6017-409e-8136-500191971c9a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1751 microversion: 2.20 time: 0.158859 Sep 07 16:00:26.628572 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 303/592] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:00:26 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:00:27.653373 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-edc6f03d-c656-4256-bbd0-cfe01064aba5 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:00:27.653964 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-edc6f03d-c656-4256-bbd0-cfe01064aba5 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:27.661110 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-edc6f03d-c656-4256-bbd0-cfe01064aba5 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:27.661589 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-edc6f03d-c656-4256-bbd0-cfe01064aba5 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:27.662018 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-edc6f03d-c656-4256-bbd0-cfe01064aba5 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:27.662697 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-edc6f03d-c656-4256-bbd0-cfe01064aba5 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:27.663143 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-edc6f03d-c656-4256-bbd0-cfe01064aba5 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:27.663581 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-edc6f03d-c656-4256-bbd0-cfe01064aba5 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:27.789529 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-edc6f03d-c656-4256-bbd0-cfe01064aba5 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:27.798207 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-edc6f03d-c656-4256-bbd0-cfe01064aba5 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:27.799644 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-edc6f03d-c656-4256-bbd0-cfe01064aba5 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:27.800779 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-edc6f03d-c656-4256-bbd0-cfe01064aba5 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1807 microversion: 2.20 time: 0.151290 Sep 07 16:00:27.801339 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 290/593] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:00:27 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:00:28.825788 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bdb6461a-99cf-44a2-ab92-64d8f9f42ac8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:00:28.826997 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bdb6461a-99cf-44a2-ab92-64d8f9f42ac8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:28.833386 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bdb6461a-99cf-44a2-ab92-64d8f9f42ac8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:28.833859 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bdb6461a-99cf-44a2-ab92-64d8f9f42ac8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:28.834287 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bdb6461a-99cf-44a2-ab92-64d8f9f42ac8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:28.834962 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bdb6461a-99cf-44a2-ab92-64d8f9f42ac8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:28.835407 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bdb6461a-99cf-44a2-ab92-64d8f9f42ac8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:28.835852 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bdb6461a-99cf-44a2-ab92-64d8f9f42ac8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:28.966154 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-bdb6461a-99cf-44a2-ab92-64d8f9f42ac8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:28.974803 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-bdb6461a-99cf-44a2-ab92-64d8f9f42ac8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:28.976482 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-bdb6461a-99cf-44a2-ab92-64d8f9f42ac8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:28.977615 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bdb6461a-99cf-44a2-ab92-64d8f9f42ac8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1807 microversion: 2.20 time: 0.155666 Sep 07 16:00:28.978160 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 304/594] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:00:28 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:00:30.002207 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2b6a229c-754e-4004-8def-25deb89afabd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:00:30.002761 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2b6a229c-754e-4004-8def-25deb89afabd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:30.009288 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b6a229c-754e-4004-8def-25deb89afabd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:30.009775 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b6a229c-754e-4004-8def-25deb89afabd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:30.010208 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b6a229c-754e-4004-8def-25deb89afabd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:30.010889 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b6a229c-754e-4004-8def-25deb89afabd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:30.011341 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b6a229c-754e-4004-8def-25deb89afabd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:30.011809 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2b6a229c-754e-4004-8def-25deb89afabd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:30.141460 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-2b6a229c-754e-4004-8def-25deb89afabd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:30.150041 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-2b6a229c-754e-4004-8def-25deb89afabd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:30.151472 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-2b6a229c-754e-4004-8def-25deb89afabd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:30.152639 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2b6a229c-754e-4004-8def-25deb89afabd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1807 microversion: 2.20 time: 0.154413 Sep 07 16:00:30.153183 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 291/595] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:00:29 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:00:31.178796 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d01fb912-89da-4683-b9b1-95a77bf89053 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:00:31.179402 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d01fb912-89da-4683-b9b1-95a77bf89053 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:31.186434 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d01fb912-89da-4683-b9b1-95a77bf89053 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:31.186909 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d01fb912-89da-4683-b9b1-95a77bf89053 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:31.187343 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d01fb912-89da-4683-b9b1-95a77bf89053 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:31.188086 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d01fb912-89da-4683-b9b1-95a77bf89053 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:31.188544 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d01fb912-89da-4683-b9b1-95a77bf89053 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:31.188957 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d01fb912-89da-4683-b9b1-95a77bf89053 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:31.379720 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d01fb912-89da-4683-b9b1-95a77bf89053 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:31.388273 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d01fb912-89da-4683-b9b1-95a77bf89053 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:31.389756 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d01fb912-89da-4683-b9b1-95a77bf89053 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:31.390912 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d01fb912-89da-4683-b9b1-95a77bf89053 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1807 microversion: 2.20 time: 0.216037 Sep 07 16:00:31.391454 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 305/596] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:00:31 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1807 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:00:32.420952 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ecd649b4-8d8e-462d-8319-e320a307db9a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:00:32.421552 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ecd649b4-8d8e-462d-8319-e320a307db9a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:32.428052 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ecd649b4-8d8e-462d-8319-e320a307db9a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:32.428527 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ecd649b4-8d8e-462d-8319-e320a307db9a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:32.428952 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ecd649b4-8d8e-462d-8319-e320a307db9a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:32.429638 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ecd649b4-8d8e-462d-8319-e320a307db9a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:32.430082 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ecd649b4-8d8e-462d-8319-e320a307db9a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:32.430497 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ecd649b4-8d8e-462d-8319-e320a307db9a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:32.569846 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-ecd649b4-8d8e-462d-8319-e320a307db9a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:32.578913 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-ecd649b4-8d8e-462d-8319-e320a307db9a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:32.580358 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-ecd649b4-8d8e-462d-8319-e320a307db9a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:32.581511 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ecd649b4-8d8e-462d-8319-e320a307db9a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1807 microversion: 2.20 time: 0.164324 Sep 07 16:00:32.582072 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 292/597] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:00:32 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:00:33.606682 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5e0500f6-45c1-4516-ba6c-1b0daa117d66 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:00:33.607258 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5e0500f6-45c1-4516-ba6c-1b0daa117d66 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:33.613715 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5e0500f6-45c1-4516-ba6c-1b0daa117d66 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:33.614194 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5e0500f6-45c1-4516-ba6c-1b0daa117d66 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:33.614624 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5e0500f6-45c1-4516-ba6c-1b0daa117d66 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:33.615308 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5e0500f6-45c1-4516-ba6c-1b0daa117d66 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:33.615783 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5e0500f6-45c1-4516-ba6c-1b0daa117d66 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:33.616537 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5e0500f6-45c1-4516-ba6c-1b0daa117d66 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:33.746087 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5e0500f6-45c1-4516-ba6c-1b0daa117d66 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:33.755069 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5e0500f6-45c1-4516-ba6c-1b0daa117d66 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:33.756502 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5e0500f6-45c1-4516-ba6c-1b0daa117d66 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:33.757635 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5e0500f6-45c1-4516-ba6c-1b0daa117d66 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1807 microversion: 2.20 time: 0.155115 Sep 07 16:00:33.758207 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 306/598] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:00:33 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:00:34.782253 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-30cc1d9d-94ad-43da-a414-a6ae5a7f17d6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:00:34.782894 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-30cc1d9d-94ad-43da-a414-a6ae5a7f17d6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:34.789393 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-30cc1d9d-94ad-43da-a414-a6ae5a7f17d6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:34.789881 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-30cc1d9d-94ad-43da-a414-a6ae5a7f17d6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:34.790319 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-30cc1d9d-94ad-43da-a414-a6ae5a7f17d6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:34.791005 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-30cc1d9d-94ad-43da-a414-a6ae5a7f17d6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:34.791461 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-30cc1d9d-94ad-43da-a414-a6ae5a7f17d6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:34.791913 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-30cc1d9d-94ad-43da-a414-a6ae5a7f17d6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:34.918109 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-30cc1d9d-94ad-43da-a414-a6ae5a7f17d6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:34.927069 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-30cc1d9d-94ad-43da-a414-a6ae5a7f17d6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:34.928531 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-30cc1d9d-94ad-43da-a414-a6ae5a7f17d6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:34.929673 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-30cc1d9d-94ad-43da-a414-a6ae5a7f17d6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1807 microversion: 2.20 time: 0.151313 Sep 07 16:00:34.930230 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 293/599] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:00:34 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:00:35.955875 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-64f99574-230f-4046-b09b-c884a07d996c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:00:35.956471 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-64f99574-230f-4046-b09b-c884a07d996c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:35.962826 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64f99574-230f-4046-b09b-c884a07d996c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:35.963297 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64f99574-230f-4046-b09b-c884a07d996c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:35.963762 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64f99574-230f-4046-b09b-c884a07d996c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:35.964437 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64f99574-230f-4046-b09b-c884a07d996c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:35.964880 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64f99574-230f-4046-b09b-c884a07d996c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:35.965295 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-64f99574-230f-4046-b09b-c884a07d996c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:36.109239 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-64f99574-230f-4046-b09b-c884a07d996c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:36.119050 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-64f99574-230f-4046-b09b-c884a07d996c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:36.120609 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-64f99574-230f-4046-b09b-c884a07d996c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:36.121755 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-64f99574-230f-4046-b09b-c884a07d996c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1807 microversion: 2.20 time: 0.169749 Sep 07 16:00:36.122304 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 307/600] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:00:35 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:00:37.146372 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c9f189fd-b5e5-46ed-b29f-35034bccea8c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:00:37.146973 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c9f189fd-b5e5-46ed-b29f-35034bccea8c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:37.153520 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c9f189fd-b5e5-46ed-b29f-35034bccea8c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:37.153999 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c9f189fd-b5e5-46ed-b29f-35034bccea8c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:37.154427 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c9f189fd-b5e5-46ed-b29f-35034bccea8c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:37.155102 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c9f189fd-b5e5-46ed-b29f-35034bccea8c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:37.155564 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c9f189fd-b5e5-46ed-b29f-35034bccea8c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:37.155986 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c9f189fd-b5e5-46ed-b29f-35034bccea8c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:37.281573 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-c9f189fd-b5e5-46ed-b29f-35034bccea8c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:37.290258 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-c9f189fd-b5e5-46ed-b29f-35034bccea8c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:37.291767 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-c9f189fd-b5e5-46ed-b29f-35034bccea8c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:37.292901 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c9f189fd-b5e5-46ed-b29f-35034bccea8c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1807 microversion: 2.20 time: 0.150407 Sep 07 16:00:37.293476 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 294/601] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:00:37 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 16:00:38.318197 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c9ac90d6-c7e4-437c-a715-90127d73ae12 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:00:38.318801 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c9ac90d6-c7e4-437c-a715-90127d73ae12 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:38.325291 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9ac90d6-c7e4-437c-a715-90127d73ae12 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:38.326444 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9ac90d6-c7e4-437c-a715-90127d73ae12 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:38.326871 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9ac90d6-c7e4-437c-a715-90127d73ae12 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:38.327574 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9ac90d6-c7e4-437c-a715-90127d73ae12 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:38.328022 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9ac90d6-c7e4-437c-a715-90127d73ae12 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:38.328438 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9ac90d6-c7e4-437c-a715-90127d73ae12 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:38.693492 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c9ac90d6-c7e4-437c-a715-90127d73ae12 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:38.701952 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c9ac90d6-c7e4-437c-a715-90127d73ae12 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:38.703370 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c9ac90d6-c7e4-437c-a715-90127d73ae12 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:38.704537 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c9ac90d6-c7e4-437c-a715-90127d73ae12 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1807 microversion: 2.20 time: 0.390223 Sep 07 16:00:38.705080 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 308/602] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:00:38 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1807 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:00:39.729335 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9bec9302-e777-4bff-a0c9-27f7be4b596d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:00:39.729942 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9bec9302-e777-4bff-a0c9-27f7be4b596d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:39.736068 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9bec9302-e777-4bff-a0c9-27f7be4b596d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:39.736544 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9bec9302-e777-4bff-a0c9-27f7be4b596d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:39.736973 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9bec9302-e777-4bff-a0c9-27f7be4b596d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:39.737650 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9bec9302-e777-4bff-a0c9-27f7be4b596d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:39.738098 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9bec9302-e777-4bff-a0c9-27f7be4b596d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:39.738523 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9bec9302-e777-4bff-a0c9-27f7be4b596d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:39.869741 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-9bec9302-e777-4bff-a0c9-27f7be4b596d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:39.878630 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-9bec9302-e777-4bff-a0c9-27f7be4b596d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:39.880082 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-9bec9302-e777-4bff-a0c9-27f7be4b596d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:39.881223 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9bec9302-e777-4bff-a0c9-27f7be4b596d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1807 microversion: 2.20 time: 0.156059 Sep 07 16:00:39.881781 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 295/603] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:00:39 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:00:40.907618 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1b49a290-0f70-4c9f-b31a-c7a63b1646ea tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:00:40.908242 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1b49a290-0f70-4c9f-b31a-c7a63b1646ea tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:40.914614 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b49a290-0f70-4c9f-b31a-c7a63b1646ea tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:40.915082 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b49a290-0f70-4c9f-b31a-c7a63b1646ea tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:40.915514 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b49a290-0f70-4c9f-b31a-c7a63b1646ea tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:40.916201 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b49a290-0f70-4c9f-b31a-c7a63b1646ea tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:40.916643 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b49a290-0f70-4c9f-b31a-c7a63b1646ea tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:40.917062 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1b49a290-0f70-4c9f-b31a-c7a63b1646ea tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:41.048355 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1b49a290-0f70-4c9f-b31a-c7a63b1646ea tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:41.061967 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1b49a290-0f70-4c9f-b31a-c7a63b1646ea tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:41.063406 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1b49a290-0f70-4c9f-b31a-c7a63b1646ea tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:41.064589 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1b49a290-0f70-4c9f-b31a-c7a63b1646ea tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1807 microversion: 2.20 time: 0.161523 Sep 07 16:00:41.065146 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 309/604] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:00:40 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:00:42.089992 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-28dc7d02-0ce5-4abd-b0fc-813c04b25888 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:00:42.090602 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-28dc7d02-0ce5-4abd-b0fc-813c04b25888 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:42.097734 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-28dc7d02-0ce5-4abd-b0fc-813c04b25888 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:42.098225 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-28dc7d02-0ce5-4abd-b0fc-813c04b25888 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:42.098664 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-28dc7d02-0ce5-4abd-b0fc-813c04b25888 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:42.099364 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-28dc7d02-0ce5-4abd-b0fc-813c04b25888 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:42.100113 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-28dc7d02-0ce5-4abd-b0fc-813c04b25888 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:42.100541 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-28dc7d02-0ce5-4abd-b0fc-813c04b25888 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:42.247594 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-28dc7d02-0ce5-4abd-b0fc-813c04b25888 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:42.256451 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-28dc7d02-0ce5-4abd-b0fc-813c04b25888 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:42.257970 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-28dc7d02-0ce5-4abd-b0fc-813c04b25888 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:42.259281 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-28dc7d02-0ce5-4abd-b0fc-813c04b25888 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1807 microversion: 2.20 time: 0.173162 Sep 07 16:00:42.260608 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 296/605] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:00:42 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:00:43.285271 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f0931082-ea7a-46b0-afef-7d75bfc73a6b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:00:43.285898 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f0931082-ea7a-46b0-afef-7d75bfc73a6b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:43.292224 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0931082-ea7a-46b0-afef-7d75bfc73a6b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:43.292695 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0931082-ea7a-46b0-afef-7d75bfc73a6b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:43.293121 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0931082-ea7a-46b0-afef-7d75bfc73a6b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:43.293800 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0931082-ea7a-46b0-afef-7d75bfc73a6b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:43.294245 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0931082-ea7a-46b0-afef-7d75bfc73a6b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:43.294657 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0931082-ea7a-46b0-afef-7d75bfc73a6b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:43.428544 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f0931082-ea7a-46b0-afef-7d75bfc73a6b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:43.437019 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f0931082-ea7a-46b0-afef-7d75bfc73a6b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:43.438451 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f0931082-ea7a-46b0-afef-7d75bfc73a6b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:43.439631 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f0931082-ea7a-46b0-afef-7d75bfc73a6b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1807 microversion: 2.20 time: 0.158228 Sep 07 16:00:43.440174 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 310/606] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:00:43 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:00:44.464534 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-27714371-9cf7-4a9e-ac07-79e357a54cab tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:00:44.465073 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-27714371-9cf7-4a9e-ac07-79e357a54cab tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:44.472009 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-27714371-9cf7-4a9e-ac07-79e357a54cab tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:44.472642 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-27714371-9cf7-4a9e-ac07-79e357a54cab tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:44.472926 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-27714371-9cf7-4a9e-ac07-79e357a54cab tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:44.473610 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-27714371-9cf7-4a9e-ac07-79e357a54cab tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:44.474065 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-27714371-9cf7-4a9e-ac07-79e357a54cab tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:44.474483 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-27714371-9cf7-4a9e-ac07-79e357a54cab tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:44.602655 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-27714371-9cf7-4a9e-ac07-79e357a54cab tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:44.611812 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-27714371-9cf7-4a9e-ac07-79e357a54cab tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:44.613382 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-27714371-9cf7-4a9e-ac07-79e357a54cab tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:44.614551 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-27714371-9cf7-4a9e-ac07-79e357a54cab tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1807 microversion: 2.20 time: 0.154074 Sep 07 16:00:44.615101 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 297/607] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:00:44 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:00:45.640894 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8e0608bb-2c78-4668-a159-f6bc25686450 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:00:45.641652 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8e0608bb-2c78-4668-a159-f6bc25686450 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:45.648244 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8e0608bb-2c78-4668-a159-f6bc25686450 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:45.648714 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8e0608bb-2c78-4668-a159-f6bc25686450 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:45.649141 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8e0608bb-2c78-4668-a159-f6bc25686450 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:45.649812 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8e0608bb-2c78-4668-a159-f6bc25686450 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:45.650250 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8e0608bb-2c78-4668-a159-f6bc25686450 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:45.650667 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8e0608bb-2c78-4668-a159-f6bc25686450 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:45.775772 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-8e0608bb-2c78-4668-a159-f6bc25686450 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:45.784811 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-8e0608bb-2c78-4668-a159-f6bc25686450 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:45.786239 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-8e0608bb-2c78-4668-a159-f6bc25686450 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:45.787395 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8e0608bb-2c78-4668-a159-f6bc25686450 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1807 microversion: 2.20 time: 0.151348 Sep 07 16:00:45.787979 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 311/608] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:00:45 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:00:46.813568 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5017bf2d-40d3-49a5-89b5-ff447085797f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:00:46.814527 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5017bf2d-40d3-49a5-89b5-ff447085797f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:46.824845 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5017bf2d-40d3-49a5-89b5-ff447085797f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:46.825697 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5017bf2d-40d3-49a5-89b5-ff447085797f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:46.826205 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5017bf2d-40d3-49a5-89b5-ff447085797f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:46.827482 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5017bf2d-40d3-49a5-89b5-ff447085797f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:46.828232 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5017bf2d-40d3-49a5-89b5-ff447085797f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:46.828730 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5017bf2d-40d3-49a5-89b5-ff447085797f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:46.975597 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-5017bf2d-40d3-49a5-89b5-ff447085797f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:46.986106 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-5017bf2d-40d3-49a5-89b5-ff447085797f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:46.987588 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-5017bf2d-40d3-49a5-89b5-ff447085797f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:46.988756 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5017bf2d-40d3-49a5-89b5-ff447085797f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1807 microversion: 2.20 time: 0.179321 Sep 07 16:00:46.989300 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 298/609] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:00:46 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:00:48.014722 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-349ac127-ed84-439e-beae-15097fa796bc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:00:48.015337 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-349ac127-ed84-439e-beae-15097fa796bc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:48.021720 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-349ac127-ed84-439e-beae-15097fa796bc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:48.022213 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-349ac127-ed84-439e-beae-15097fa796bc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:48.022629 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-349ac127-ed84-439e-beae-15097fa796bc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:48.023311 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-349ac127-ed84-439e-beae-15097fa796bc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:48.023786 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-349ac127-ed84-439e-beae-15097fa796bc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:48.024218 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-349ac127-ed84-439e-beae-15097fa796bc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:48.159903 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-349ac127-ed84-439e-beae-15097fa796bc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:48.168468 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-349ac127-ed84-439e-beae-15097fa796bc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:48.169897 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-349ac127-ed84-439e-beae-15097fa796bc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:48.171087 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-349ac127-ed84-439e-beae-15097fa796bc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1807 microversion: 2.20 time: 0.160332 Sep 07 16:00:48.171840 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 312/610] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:00:48 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:00:49.196603 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-496728b6-399d-48ab-8386-bd54f9728bf4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:00:49.197760 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-496728b6-399d-48ab-8386-bd54f9728bf4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:49.204727 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-496728b6-399d-48ab-8386-bd54f9728bf4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:49.205315 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-496728b6-399d-48ab-8386-bd54f9728bf4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:49.205834 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-496728b6-399d-48ab-8386-bd54f9728bf4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:49.206609 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-496728b6-399d-48ab-8386-bd54f9728bf4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:49.207141 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-496728b6-399d-48ab-8386-bd54f9728bf4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:49.207803 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-496728b6-399d-48ab-8386-bd54f9728bf4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:49.210903 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:49.345830 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-496728b6-399d-48ab-8386-bd54f9728bf4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:49.354682 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-496728b6-399d-48ab-8386-bd54f9728bf4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:49.356206 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-496728b6-399d-48ab-8386-bd54f9728bf4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:49.357355 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-496728b6-399d-48ab-8386-bd54f9728bf4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1807 microversion: 2.20 time: 0.164778 Sep 07 16:00:49.358439 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 299/611] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:00:49 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:00:50.383766 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9bb8406f-f5a3-44c8-9851-35aeb7ace9a2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:00:50.384360 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9bb8406f-f5a3-44c8-9851-35aeb7ace9a2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:50.391918 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9bb8406f-f5a3-44c8-9851-35aeb7ace9a2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:50.392405 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9bb8406f-f5a3-44c8-9851-35aeb7ace9a2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:50.394394 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9bb8406f-f5a3-44c8-9851-35aeb7ace9a2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:50.395218 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9bb8406f-f5a3-44c8-9851-35aeb7ace9a2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:50.395795 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9bb8406f-f5a3-44c8-9851-35aeb7ace9a2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:50.396360 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9bb8406f-f5a3-44c8-9851-35aeb7ace9a2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:50.528455 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9bb8406f-f5a3-44c8-9851-35aeb7ace9a2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:50.537079 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9bb8406f-f5a3-44c8-9851-35aeb7ace9a2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:50.538498 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9bb8406f-f5a3-44c8-9851-35aeb7ace9a2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:50.539669 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9bb8406f-f5a3-44c8-9851-35aeb7ace9a2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1807 microversion: 2.20 time: 0.160089 Sep 07 16:00:50.540223 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 313/612] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:00:50 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:00:51.565357 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f717ce1c-7a33-4291-a8b0-c9a994b2b017 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:00:51.566319 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f717ce1c-7a33-4291-a8b0-c9a994b2b017 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:51.572370 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f717ce1c-7a33-4291-a8b0-c9a994b2b017 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:51.572855 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f717ce1c-7a33-4291-a8b0-c9a994b2b017 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:51.573288 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f717ce1c-7a33-4291-a8b0-c9a994b2b017 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:51.573977 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f717ce1c-7a33-4291-a8b0-c9a994b2b017 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:51.574430 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f717ce1c-7a33-4291-a8b0-c9a994b2b017 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:51.574869 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f717ce1c-7a33-4291-a8b0-c9a994b2b017 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:51.754822 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-f717ce1c-7a33-4291-a8b0-c9a994b2b017 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:51.763707 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-f717ce1c-7a33-4291-a8b0-c9a994b2b017 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:51.765135 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-f717ce1c-7a33-4291-a8b0-c9a994b2b017 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:51.766882 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f717ce1c-7a33-4291-a8b0-c9a994b2b017 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1807 microversion: 2.20 time: 0.204884 Sep 07 16:00:51.767586 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 300/613] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:00:51 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1807 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:00:52.792232 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-079cda82-2ccd-4d83-803e-fcc147c10a89 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:00:52.792829 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-079cda82-2ccd-4d83-803e-fcc147c10a89 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:52.795198 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=28 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:52.800526 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-079cda82-2ccd-4d83-803e-fcc147c10a89 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:52.801006 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-079cda82-2ccd-4d83-803e-fcc147c10a89 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:52.801435 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-079cda82-2ccd-4d83-803e-fcc147c10a89 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:52.802108 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-079cda82-2ccd-4d83-803e-fcc147c10a89 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:52.802551 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-079cda82-2ccd-4d83-803e-fcc147c10a89 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:52.802969 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-079cda82-2ccd-4d83-803e-fcc147c10a89 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:52.986569 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-079cda82-2ccd-4d83-803e-fcc147c10a89 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:52.995041 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-079cda82-2ccd-4d83-803e-fcc147c10a89 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:52.996495 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-079cda82-2ccd-4d83-803e-fcc147c10a89 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:52.997639 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-079cda82-2ccd-4d83-803e-fcc147c10a89 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1807 microversion: 2.20 time: 0.209358 Sep 07 16:00:52.998182 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 314/614] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:00:52 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1807 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:00:54.001530 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d987b5b0-45c4-4879-a72d-7758bd148afa tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:00:54.002017 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d987b5b0-45c4-4879-a72d-7758bd148afa tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 7807823a-6888-4edf-90cf-3f72de9017c7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:54.008377 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d987b5b0-45c4-4879-a72d-7758bd148afa tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:54.008855 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d987b5b0-45c4-4879-a72d-7758bd148afa tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:54.009282 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d987b5b0-45c4-4879-a72d-7758bd148afa tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:54.009960 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d987b5b0-45c4-4879-a72d-7758bd148afa tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:54.010409 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d987b5b0-45c4-4879-a72d-7758bd148afa tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:54.010845 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d987b5b0-45c4-4879-a72d-7758bd148afa tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:54.022134 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-71d5c495-3456-4af3-ace2-22e0e53511e4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:00:54.022764 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-71d5c495-3456-4af3-ace2-22e0e53511e4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:54.029107 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71d5c495-3456-4af3-ace2-22e0e53511e4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:54.029580 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71d5c495-3456-4af3-ace2-22e0e53511e4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:54.030010 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71d5c495-3456-4af3-ace2-22e0e53511e4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:54.030687 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71d5c495-3456-4af3-ace2-22e0e53511e4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:54.031136 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71d5c495-3456-4af3-ace2-22e0e53511e4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:54.031579 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-71d5c495-3456-4af3-ace2-22e0e53511e4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:54.135837 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-d987b5b0-45c4-4879-a72d-7758bd148afa tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lazy-loading 'services' on Instance uuid 7807823a-6888-4edf-90cf-3f72de9017c7 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 16:00:54.165309 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-71d5c495-3456-4af3-ace2-22e0e53511e4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:54.174439 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-71d5c495-3456-4af3-ace2-22e0e53511e4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:54.176133 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-71d5c495-3456-4af3-ace2-22e0e53511e4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:54.177288 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-71d5c495-3456-4af3-ace2-22e0e53511e4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1807 microversion: 2.20 time: 0.159017 Sep 07 16:00:54.177836 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 315/615] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:00:54 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 16:00:54.254322 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d987b5b0-45c4-4879-a72d-7758bd148afa tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7/os-volume_attachments/7eab509d-cc4a-4e17-bbed-5407915bd780" status: 202 len: 0 microversion: 2.1 time: 0.256468 Sep 07 16:00:54.254928 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 301/616] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Sep 7 16:00:53 2022] DELETE /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7/os-volume_attachments/7eab509d-cc4a-4e17-bbed-5407915bd780 => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 16:00:55.202078 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8e609a5b-c29a-4f44-b34a-d2c03813e93d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:00:55.202689 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8e609a5b-c29a-4f44-b34a-d2c03813e93d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:55.209001 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8e609a5b-c29a-4f44-b34a-d2c03813e93d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:55.209477 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8e609a5b-c29a-4f44-b34a-d2c03813e93d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:55.209913 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8e609a5b-c29a-4f44-b34a-d2c03813e93d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:55.210599 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8e609a5b-c29a-4f44-b34a-d2c03813e93d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:55.211053 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8e609a5b-c29a-4f44-b34a-d2c03813e93d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:55.211480 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8e609a5b-c29a-4f44-b34a-d2c03813e93d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:55.339695 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-8e609a5b-c29a-4f44-b34a-d2c03813e93d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:55.348088 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-8e609a5b-c29a-4f44-b34a-d2c03813e93d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:55.349498 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-8e609a5b-c29a-4f44-b34a-d2c03813e93d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:55.350898 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8e609a5b-c29a-4f44-b34a-d2c03813e93d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1807 microversion: 2.20 time: 0.152700 Sep 07 16:00:55.351444 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 316/617] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:00:55 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:00:56.377362 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-831068ff-c454-4248-bd6b-4ea3c8bef8d6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:00:56.378282 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-831068ff-c454-4248-bd6b-4ea3c8bef8d6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:56.380038 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=26 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:56.386483 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-831068ff-c454-4248-bd6b-4ea3c8bef8d6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:56.386969 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-831068ff-c454-4248-bd6b-4ea3c8bef8d6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:56.387402 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-831068ff-c454-4248-bd6b-4ea3c8bef8d6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:56.388167 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-831068ff-c454-4248-bd6b-4ea3c8bef8d6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:56.388620 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-831068ff-c454-4248-bd6b-4ea3c8bef8d6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:56.389042 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-831068ff-c454-4248-bd6b-4ea3c8bef8d6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:56.434672 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ce55af54-4aa3-483c-b823-b7db2c6e1a98 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:00:56.435214 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ce55af54-4aa3-483c-b823-b7db2c6e1a98 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 7807823a-6888-4edf-90cf-3f72de9017c7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:56.442050 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce55af54-4aa3-483c-b823-b7db2c6e1a98 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:56.442534 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce55af54-4aa3-483c-b823-b7db2c6e1a98 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:56.442968 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce55af54-4aa3-483c-b823-b7db2c6e1a98 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:56.443719 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce55af54-4aa3-483c-b823-b7db2c6e1a98 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:56.444171 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce55af54-4aa3-483c-b823-b7db2c6e1a98 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:56.444600 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce55af54-4aa3-483c-b823-b7db2c6e1a98 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:56.470394 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ce55af54-4aa3-483c-b823-b7db2c6e1a98 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 7807823a-6888-4edf-90cf-3f72de9017c7] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 16:00:56.495147 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=93 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:56.521500 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-831068ff-c454-4248-bd6b-4ea3c8bef8d6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:56.532309 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-831068ff-c454-4248-bd6b-4ea3c8bef8d6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:56.534097 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-831068ff-c454-4248-bd6b-4ea3c8bef8d6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:56.535284 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-831068ff-c454-4248-bd6b-4ea3c8bef8d6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1807 microversion: 2.20 time: 0.163153 Sep 07 16:00:56.535878 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 302/618] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:00:56 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:00:56.549995 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ce55af54-4aa3-483c-b823-b7db2c6e1a98 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7" status: 204 len: 0 microversion: 2.1 time: 0.118855 Sep 07 16:00:56.550552 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 317/619] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Sep 7 16:00:56 2022] DELETE /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 16:00:56.559120 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f47f6a70-7d9c-4378-86e7-9cde5bdcded9 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:00:56.559953 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f47f6a70-7d9c-4378-86e7-9cde5bdcded9 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 7807823a-6888-4edf-90cf-3f72de9017c7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:56.566551 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f47f6a70-7d9c-4378-86e7-9cde5bdcded9 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:56.567029 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f47f6a70-7d9c-4378-86e7-9cde5bdcded9 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:56.567460 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f47f6a70-7d9c-4378-86e7-9cde5bdcded9 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:56.568159 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f47f6a70-7d9c-4378-86e7-9cde5bdcded9 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:56.568612 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f47f6a70-7d9c-4378-86e7-9cde5bdcded9 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:56.569027 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f47f6a70-7d9c-4378-86e7-9cde5bdcded9 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:56.696532 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-f47f6a70-7d9c-4378-86e7-9cde5bdcded9 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e9cc0ef8394696b127a32edd75e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8213db22feb041c196d02aaeac22d875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:56.704122 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f47f6a70-7d9c-4378-86e7-9cde5bdcded9 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7" status: 200 len: 1513 microversion: 2.1 time: 0.148983 Sep 07 16:00:56.704674 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 303/620] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:00:56 2022] GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7 => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 16:00:57.563049 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-36e44b18-078b-4903-80cc-cf5afdcbed61 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:00:57.563698 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-36e44b18-078b-4903-80cc-cf5afdcbed61 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:57.569970 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36e44b18-078b-4903-80cc-cf5afdcbed61 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:57.570446 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36e44b18-078b-4903-80cc-cf5afdcbed61 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:57.570879 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36e44b18-078b-4903-80cc-cf5afdcbed61 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:57.571567 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36e44b18-078b-4903-80cc-cf5afdcbed61 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:57.572029 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36e44b18-078b-4903-80cc-cf5afdcbed61 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:57.572449 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36e44b18-078b-4903-80cc-cf5afdcbed61 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:57.704158 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-36e44b18-078b-4903-80cc-cf5afdcbed61 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:57.712663 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-36e44b18-078b-4903-80cc-cf5afdcbed61 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:57.714128 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-36e44b18-078b-4903-80cc-cf5afdcbed61 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:57.715271 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-36e44b18-078b-4903-80cc-cf5afdcbed61 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1807 microversion: 2.20 time: 0.156579 Sep 07 16:00:57.715863 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 318/621] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:00:57 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:00:57.726188 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ca65e1c0-5be6-4d6d-aefa-da5eff77f72d tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:00:57.726874 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ca65e1c0-5be6-4d6d-aefa-da5eff77f72d tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 7807823a-6888-4edf-90cf-3f72de9017c7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:57.733251 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca65e1c0-5be6-4d6d-aefa-da5eff77f72d tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:57.733731 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca65e1c0-5be6-4d6d-aefa-da5eff77f72d tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:57.734165 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca65e1c0-5be6-4d6d-aefa-da5eff77f72d tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:57.734844 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca65e1c0-5be6-4d6d-aefa-da5eff77f72d tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:57.735416 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca65e1c0-5be6-4d6d-aefa-da5eff77f72d tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:57.735869 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ca65e1c0-5be6-4d6d-aefa-da5eff77f72d tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:57.863083 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-ca65e1c0-5be6-4d6d-aefa-da5eff77f72d tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e9cc0ef8394696b127a32edd75e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8213db22feb041c196d02aaeac22d875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:57.870596 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ca65e1c0-5be6-4d6d-aefa-da5eff77f72d tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7" status: 200 len: 1513 microversion: 2.1 time: 0.148377 Sep 07 16:00:57.871150 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 304/622] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:00:57 2022] GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7 => generated 1513 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:00:58.741191 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2162e9b2-2c41-422c-996f-ccaf89f2779d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:00:58.741789 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2162e9b2-2c41-422c-996f-ccaf89f2779d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:58.748168 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2162e9b2-2c41-422c-996f-ccaf89f2779d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:58.748640 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2162e9b2-2c41-422c-996f-ccaf89f2779d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:58.749088 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2162e9b2-2c41-422c-996f-ccaf89f2779d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:58.749766 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2162e9b2-2c41-422c-996f-ccaf89f2779d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:58.750206 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2162e9b2-2c41-422c-996f-ccaf89f2779d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:58.750676 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2162e9b2-2c41-422c-996f-ccaf89f2779d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:58.878054 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2162e9b2-2c41-422c-996f-ccaf89f2779d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:58.886467 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2162e9b2-2c41-422c-996f-ccaf89f2779d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:58.887931 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2162e9b2-2c41-422c-996f-ccaf89f2779d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:58.889069 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2162e9b2-2c41-422c-996f-ccaf89f2779d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1807 microversion: 2.20 time: 0.151780 Sep 07 16:00:58.889608 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 319/623] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:00:58 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:00:58.894757 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9356f456-ded1-4e7d-957b-89d3a25a7d74 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:00:58.895362 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9356f456-ded1-4e7d-957b-89d3a25a7d74 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 7807823a-6888-4edf-90cf-3f72de9017c7] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:58.901837 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9356f456-ded1-4e7d-957b-89d3a25a7d74 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:58.902351 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9356f456-ded1-4e7d-957b-89d3a25a7d74 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:58.902785 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9356f456-ded1-4e7d-957b-89d3a25a7d74 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:58.903479 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9356f456-ded1-4e7d-957b-89d3a25a7d74 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:58.903975 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9356f456-ded1-4e7d-957b-89d3a25a7d74 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:58.904400 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9356f456-ded1-4e7d-957b-89d3a25a7d74 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:59.030551 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-9356f456-ded1-4e7d-957b-89d3a25a7d74 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e9cc0ef8394696b127a32edd75e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8213db22feb041c196d02aaeac22d875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:00:59.038685 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9356f456-ded1-4e7d-957b-89d3a25a7d74 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7" status: 200 len: 1513 microversion: 2.1 time: 0.148262 Sep 07 16:00:59.039241 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 305/624] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:00:58 2022] GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7 => generated 1513 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:00:59.455703 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-93cb3bd9-e36c-4a78-abba-1e935c5385a0 req-807cd4bb-5519-4e08-8a8c-fa26b2991a53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7807823a-6888-4edf-90cf-3f72de9017c7", "name": "network-vif-deleted", "tag": "d4135853-bbb1-4003-986f-0834bf734654"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:00:59.465520 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-93cb3bd9-e36c-4a78-abba-1e935c5385a0 req-807cd4bb-5519-4e08-8a8c-fa26b2991a53 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:59.465993 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-93cb3bd9-e36c-4a78-abba-1e935c5385a0 req-807cd4bb-5519-4e08-8a8c-fa26b2991a53 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:59.466415 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-93cb3bd9-e36c-4a78-abba-1e935c5385a0 req-807cd4bb-5519-4e08-8a8c-fa26b2991a53 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:59.477488 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-93cb3bd9-e36c-4a78-abba-1e935c5385a0 req-807cd4bb-5519-4e08-8a8c-fa26b2991a53 service nova] Creating event network-vif-deleted:d4135853-bbb1-4003-986f-0834bf734654 for instance 7807823a-6888-4edf-90cf-3f72de9017c7 on hv-cinder-85331 Sep 07 16:00:59.482154 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-93cb3bd9-e36c-4a78-abba-1e935c5385a0 req-807cd4bb-5519-4e08-8a8c-fa26b2991a53 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030751 Sep 07 16:00:59.483047 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 320/625] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:00:59.914046 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-aafa8b04-eb2d-4f25-8f4f-1dda297d9cfe tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:00:59.914644 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-aafa8b04-eb2d-4f25-8f4f-1dda297d9cfe tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:00:59.921851 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aafa8b04-eb2d-4f25-8f4f-1dda297d9cfe tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:59.922987 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aafa8b04-eb2d-4f25-8f4f-1dda297d9cfe tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:59.923418 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aafa8b04-eb2d-4f25-8f4f-1dda297d9cfe tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:00:59.924150 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aafa8b04-eb2d-4f25-8f4f-1dda297d9cfe tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:00:59.924595 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aafa8b04-eb2d-4f25-8f4f-1dda297d9cfe tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:00:59.925035 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aafa8b04-eb2d-4f25-8f4f-1dda297d9cfe tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:00.062494 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a266e53d-7ae6-44f5-8ed4-28ae1a808722 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:01:00.063304 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a266e53d-7ae6-44f5-8ed4-28ae1a808722 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 7807823a-6888-4edf-90cf-3f72de9017c7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:01:00.070028 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a266e53d-7ae6-44f5-8ed4-28ae1a808722 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:00.070514 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a266e53d-7ae6-44f5-8ed4-28ae1a808722 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:00.070947 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a266e53d-7ae6-44f5-8ed4-28ae1a808722 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:00.071796 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a266e53d-7ae6-44f5-8ed4-28ae1a808722 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:00.072209 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a266e53d-7ae6-44f5-8ed4-28ae1a808722 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:00.072935 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a266e53d-7ae6-44f5-8ed4-28ae1a808722 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:00.106659 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a266e53d-7ae6-44f5-8ed4-28ae1a808722 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:00.107142 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a266e53d-7ae6-44f5-8ed4-28ae1a808722 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:00.107603 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a266e53d-7ae6-44f5-8ed4-28ae1a808722 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:00.108052 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-a266e53d-7ae6-44f5-8ed4-28ae1a808722 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lazy-loading 'fault' on Instance uuid 7807823a-6888-4edf-90cf-3f72de9017c7 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 16:01:00.151598 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a266e53d-7ae6-44f5-8ed4-28ae1a808722 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e9cc0ef8394696b127a32edd75e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8213db22feb041c196d02aaeac22d875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:00.160515 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a266e53d-7ae6-44f5-8ed4-28ae1a808722 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7" status: 200 len: 1309 microversion: 2.1 time: 0.102426 Sep 07 16:01:00.175624 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 321/626] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:01:00 2022] GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7 => generated 1309 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 16:01:00.252175 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-aafa8b04-eb2d-4f25-8f4f-1dda297d9cfe tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:00.260657 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-aafa8b04-eb2d-4f25-8f4f-1dda297d9cfe tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:00.262087 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-aafa8b04-eb2d-4f25-8f4f-1dda297d9cfe tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:00.263232 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-aafa8b04-eb2d-4f25-8f4f-1dda297d9cfe tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1807 microversion: 2.20 time: 0.352988 Sep 07 16:01:00.263825 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 306/627] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:00:59 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1807 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:01:01.185016 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-168225da-7492-44a0-97be-b144d4f8e09b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:01:01.185627 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-168225da-7492-44a0-97be-b144d4f8e09b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 7807823a-6888-4edf-90cf-3f72de9017c7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:01:01.192708 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-168225da-7492-44a0-97be-b144d4f8e09b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:01.193212 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-168225da-7492-44a0-97be-b144d4f8e09b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:01.193646 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-168225da-7492-44a0-97be-b144d4f8e09b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:01.194329 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-168225da-7492-44a0-97be-b144d4f8e09b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:01.194775 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-168225da-7492-44a0-97be-b144d4f8e09b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:01.195201 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-168225da-7492-44a0-97be-b144d4f8e09b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:01.224386 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-168225da-7492-44a0-97be-b144d4f8e09b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:01.225113 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-168225da-7492-44a0-97be-b144d4f8e09b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:01.225544 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-168225da-7492-44a0-97be-b144d4f8e09b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:01.225981 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-168225da-7492-44a0-97be-b144d4f8e09b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lazy-loading 'fault' on Instance uuid 7807823a-6888-4edf-90cf-3f72de9017c7 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 16:01:01.266104 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-168225da-7492-44a0-97be-b144d4f8e09b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e9cc0ef8394696b127a32edd75e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8213db22feb041c196d02aaeac22d875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:01.273762 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-168225da-7492-44a0-97be-b144d4f8e09b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7" status: 200 len: 1309 microversion: 2.1 time: 0.092594 Sep 07 16:01:01.274323 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 322/628] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:01:01 2022] GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7 => generated 1309 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:01:01.289261 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3b0af381-7617-49fa-8863-25e0539de820 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:01:01.289868 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3b0af381-7617-49fa-8863-25e0539de820 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:01:01.296321 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b0af381-7617-49fa-8863-25e0539de820 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:01.296804 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b0af381-7617-49fa-8863-25e0539de820 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:01.297746 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b0af381-7617-49fa-8863-25e0539de820 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:01.298426 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b0af381-7617-49fa-8863-25e0539de820 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:01.298877 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b0af381-7617-49fa-8863-25e0539de820 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:01.299297 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3b0af381-7617-49fa-8863-25e0539de820 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:01.424393 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-3b0af381-7617-49fa-8863-25e0539de820 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:01.432741 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-3b0af381-7617-49fa-8863-25e0539de820 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:01.434164 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-3b0af381-7617-49fa-8863-25e0539de820 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:01.435307 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3b0af381-7617-49fa-8863-25e0539de820 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1807 microversion: 2.20 time: 0.149851 Sep 07 16:01:01.435904 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 307/629] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:01:01 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1807 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:01:02.296312 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dbe067be-9707-4d70-a303-759716e324b6 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:01:02.296917 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dbe067be-9707-4d70-a303-759716e324b6 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 7807823a-6888-4edf-90cf-3f72de9017c7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:01:02.304771 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbe067be-9707-4d70-a303-759716e324b6 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:02.305282 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbe067be-9707-4d70-a303-759716e324b6 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:02.305821 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbe067be-9707-4d70-a303-759716e324b6 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:02.306611 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbe067be-9707-4d70-a303-759716e324b6 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:02.307058 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbe067be-9707-4d70-a303-759716e324b6 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:02.307481 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbe067be-9707-4d70-a303-759716e324b6 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:02.340868 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbe067be-9707-4d70-a303-759716e324b6 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:02.341342 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbe067be-9707-4d70-a303-759716e324b6 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:02.341768 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dbe067be-9707-4d70-a303-759716e324b6 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:02.342200 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-dbe067be-9707-4d70-a303-759716e324b6 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lazy-loading 'fault' on Instance uuid 7807823a-6888-4edf-90cf-3f72de9017c7 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 16:01:02.384840 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-dbe067be-9707-4d70-a303-759716e324b6 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e9cc0ef8394696b127a32edd75e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8213db22feb041c196d02aaeac22d875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:02.392877 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dbe067be-9707-4d70-a303-759716e324b6 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7" status: 200 len: 1309 microversion: 2.1 time: 0.100489 Sep 07 16:01:02.393422 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 323/630] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:01:02 2022] GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7 => generated 1309 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:01:02.460622 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-de2f9702-12cc-469b-ba48-8ceca8af1222 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:01:02.461135 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-de2f9702-12cc-469b-ba48-8ceca8af1222 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:01:02.467638 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de2f9702-12cc-469b-ba48-8ceca8af1222 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:02.468118 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de2f9702-12cc-469b-ba48-8ceca8af1222 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:02.468555 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de2f9702-12cc-469b-ba48-8ceca8af1222 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:02.469232 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de2f9702-12cc-469b-ba48-8ceca8af1222 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:02.469683 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de2f9702-12cc-469b-ba48-8ceca8af1222 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:02.470101 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de2f9702-12cc-469b-ba48-8ceca8af1222 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:02.603877 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-de2f9702-12cc-469b-ba48-8ceca8af1222 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:02.613306 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-de2f9702-12cc-469b-ba48-8ceca8af1222 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:02.614717 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-de2f9702-12cc-469b-ba48-8ceca8af1222 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:02.615893 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-de2f9702-12cc-469b-ba48-8ceca8af1222 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1807 microversion: 2.20 time: 0.159172 Sep 07 16:01:02.616437 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 308/631] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:01:02 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:01:03.415619 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-27737eec-10f7-4bdd-b78f-acf895e68a64 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:01:03.416152 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-27737eec-10f7-4bdd-b78f-acf895e68a64 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 7807823a-6888-4edf-90cf-3f72de9017c7] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:01:03.422960 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-27737eec-10f7-4bdd-b78f-acf895e68a64 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:03.423446 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-27737eec-10f7-4bdd-b78f-acf895e68a64 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:03.423939 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-27737eec-10f7-4bdd-b78f-acf895e68a64 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:03.424671 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-27737eec-10f7-4bdd-b78f-acf895e68a64 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:03.425125 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-27737eec-10f7-4bdd-b78f-acf895e68a64 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:03.425551 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-27737eec-10f7-4bdd-b78f-acf895e68a64 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:03.440138 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-27737eec-10f7-4bdd-b78f-acf895e68a64 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] HTTP exception thrown: Instance 7807823a-6888-4edf-90cf-3f72de9017c7 could not be found. Sep 07 16:01:03.442020 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-27737eec-10f7-4bdd-b78f-acf895e68a64 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Request method failure captured: Sep 07 16:01:03.442020 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7 HTTP/1.1 Sep 07 16:01:03.442020 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept: application/json Sep 07 16:01:03.442020 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Sep 07 16:01:03.442020 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Connection: close Sep 07 16:01:03.442020 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Length: 0 Sep 07 16:01:03.442020 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Type: application/json Sep 07 16:01:03.442020 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Host: 10.222.0.17 Sep 07 16:01:03.442020 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Sep 07 16:01:03.442020 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Sep 07 16:01:03.442020 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjGL_F4Mi7EQLlV5UyEG5L4MpK2OSIUZj5JGM63dIMmrkVmVgaqwPzQrk2bnRVGJAHG2JUcewauNBe2rMLfj3ddjP5siG4R7iavke5O1XapuKGG-_6-HLwItFilmDQ3S--2S-NZ8i6X4-brTEkdihm3nJV2j_OC8VOht-KInUoO0d91VU Sep 07 16:01:03.442020 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Sep 07 16:01:03.442020 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Sep 07 16:01:03.442020 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Sep 07 16:01:03.442020 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Sep 07 16:01:03.442020 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Sep 07 16:01:03.442020 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Sep 07 16:01:03.442020 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Id: 8213db22feb041c196d02aaeac22d875 Sep 07 16:01:03.442020 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-VolumesSnapshotTestJSON-280465660 Sep 07 16:01:03.442020 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Role: reader,member Sep 07 16:01:03.442020 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Roles: reader,member Sep 07 16:01:03.443503 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8213db22feb041c196d02aaeac22d875", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8213db22feb041c196d02aaeac22d875"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8213db22feb041c196d02aaeac22d875"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8213db22feb041c196d02aaeac22d875"}]}] Sep 07 16:01:03.443503 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-VolumesSnapshotTestJSON-280465660 Sep 07 16:01:03.443503 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Id: 8213db22feb041c196d02aaeac22d875 Sep 07 16:01:03.443503 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-280465660 Sep 07 16:01:03.443503 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User: tempest-VolumesSnapshotTestJSON-280465660-project Sep 07 16:01:03.443503 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Sep 07 16:01:03.443503 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Sep 07 16:01:03.443503 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Id: c2e9cc0ef8394696b127a32edd75e885 Sep 07 16:01:03.443503 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-VolumesSnapshotTestJSON-280465660-project Sep 07 16:01:03.443503 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: method: > Sep 07 16:01:03.443503 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: exception: Instance 7807823a-6888-4edf-90cf-3f72de9017c7 could not be found. Sep 07 16:01:03.443503 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: action_args: {'id': '7807823a-6888-4edf-90cf-3f72de9017c7'} Sep 07 16:01:03.444427 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 16:01:03.444427 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:01:03.444427 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 16:01:03.444427 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 16:01:03.444427 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 16:01:03.444427 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 16:01:03.444427 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 16:01:03.444427 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 16:01:03.444427 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 16:01:03.444427 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 16:01:03.444427 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7807823a-6888-4edf-90cf-3f72de9017c7 could not be found. Sep 07 16:01:03.444427 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:01:03.444427 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:01:03.444427 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:01:03.444427 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:01:03.444427 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:01:03.444427 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:01:03.444427 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 16:01:03.444427 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 16:01:03.444427 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 16:01:03.445666 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 16:01:03.445666 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 16:01:03.445666 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 16:01:03.445666 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 16:01:03.445666 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 16:01:03.445666 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 16:01:03.445666 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 16:01:03.445666 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7807823a-6888-4edf-90cf-3f72de9017c7 could not be found. Sep 07 16:01:03.445666 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:01:03.445666 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:01:03.445666 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:01:03.445666 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:01:03.445666 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:01:03.445666 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:01:03.445666 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 16:01:03.445666 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 16:01:03.445666 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7807823a-6888-4edf-90cf-3f72de9017c7 could not be found. Sep 07 16:01:03.445666 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:01:03.448046 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-27737eec-10f7-4bdd-b78f-acf895e68a64 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Returning 404 to user: Instance 7807823a-6888-4edf-90cf-3f72de9017c7 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 16:01:03.448046 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-27737eec-10f7-4bdd-b78f-acf895e68a64 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7" status: 404 len: 111 microversion: 2.1 time: 0.031809 Sep 07 16:01:03.448046 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 324/632] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:01:03 2022] GET /compute/v2.1/servers/7807823a-6888-4edf-90cf-3f72de9017c7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 16:01:03.647033 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1ac09a88-8750-4611-b045-3111fcd713a0 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:01:03.649654 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1ac09a88-8750-4611-b045-3111fcd713a0 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:01:03.657871 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1ac09a88-8750-4611-b045-3111fcd713a0 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:03.659231 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1ac09a88-8750-4611-b045-3111fcd713a0 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:03.659778 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1ac09a88-8750-4611-b045-3111fcd713a0 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:03.661211 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1ac09a88-8750-4611-b045-3111fcd713a0 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:03.662524 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1ac09a88-8750-4611-b045-3111fcd713a0 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:03.663874 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1ac09a88-8750-4611-b045-3111fcd713a0 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:03.807072 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-1ac09a88-8750-4611-b045-3111fcd713a0 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:03.816380 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-1ac09a88-8750-4611-b045-3111fcd713a0 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:03.817799 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-1ac09a88-8750-4611-b045-3111fcd713a0 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:03.818949 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1ac09a88-8750-4611-b045-3111fcd713a0 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1807 microversion: 2.20 time: 0.178747 Sep 07 16:01:03.819497 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 309/633] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:01:03 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:01:04.845437 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0c7efb3e-4d9b-4a46-95be-4b1ee3e959bb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:01:04.846033 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0c7efb3e-4d9b-4a46-95be-4b1ee3e959bb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:01:04.852558 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c7efb3e-4d9b-4a46-95be-4b1ee3e959bb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:04.853031 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c7efb3e-4d9b-4a46-95be-4b1ee3e959bb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:04.853465 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c7efb3e-4d9b-4a46-95be-4b1ee3e959bb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:04.854134 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c7efb3e-4d9b-4a46-95be-4b1ee3e959bb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:04.854574 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c7efb3e-4d9b-4a46-95be-4b1ee3e959bb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:04.854986 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0c7efb3e-4d9b-4a46-95be-4b1ee3e959bb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:05.072975 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-0c7efb3e-4d9b-4a46-95be-4b1ee3e959bb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:05.082010 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-0c7efb3e-4d9b-4a46-95be-4b1ee3e959bb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:05.083427 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-0c7efb3e-4d9b-4a46-95be-4b1ee3e959bb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:05.084596 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0c7efb3e-4d9b-4a46-95be-4b1ee3e959bb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1807 microversion: 2.20 time: 0.243670 Sep 07 16:01:05.085142 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 325/634] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:01:04 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1807 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:01:06.111258 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e1fe7d69-1ab1-4907-a7b7-5351143e8818 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:01:06.111812 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e1fe7d69-1ab1-4907-a7b7-5351143e8818 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:01:06.118308 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e1fe7d69-1ab1-4907-a7b7-5351143e8818 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:06.118792 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e1fe7d69-1ab1-4907-a7b7-5351143e8818 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:06.119225 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e1fe7d69-1ab1-4907-a7b7-5351143e8818 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:06.119941 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e1fe7d69-1ab1-4907-a7b7-5351143e8818 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:06.120395 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e1fe7d69-1ab1-4907-a7b7-5351143e8818 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:06.120816 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e1fe7d69-1ab1-4907-a7b7-5351143e8818 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:06.195569 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 16:01:06.195829 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Wed Sep 7 16:01:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a (ip 10.222.0.17) !!! Sep 07 16:01:06.249341 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-e1fe7d69-1ab1-4907-a7b7-5351143e8818 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:06.257960 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-e1fe7d69-1ab1-4907-a7b7-5351143e8818 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:06.259382 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-e1fe7d69-1ab1-4907-a7b7-5351143e8818 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:06.260555 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e1fe7d69-1ab1-4907-a7b7-5351143e8818 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1807 microversion: 2.20 time: 0.153943 Sep 07 16:01:06.261102 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 310/635] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:01:06 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:01:07.286068 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a2b0a41b-ceeb-44f6-bbf2-1eb4fdcc7362 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:01:07.286789 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a2b0a41b-ceeb-44f6-bbf2-1eb4fdcc7362 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:01:07.289651 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 16:01:07.289802 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Wed Sep 7 16:01:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a (ip 10.222.0.17) !!! Sep 07 16:01:07.295956 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2b0a41b-ceeb-44f6-bbf2-1eb4fdcc7362 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:07.296055 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2b0a41b-ceeb-44f6-bbf2-1eb4fdcc7362 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:07.296475 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2b0a41b-ceeb-44f6-bbf2-1eb4fdcc7362 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:07.297166 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2b0a41b-ceeb-44f6-bbf2-1eb4fdcc7362 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:07.297614 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2b0a41b-ceeb-44f6-bbf2-1eb4fdcc7362 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:07.298577 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a2b0a41b-ceeb-44f6-bbf2-1eb4fdcc7362 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:07.426758 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a2b0a41b-ceeb-44f6-bbf2-1eb4fdcc7362 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:07.435238 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a2b0a41b-ceeb-44f6-bbf2-1eb4fdcc7362 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:07.436697 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a2b0a41b-ceeb-44f6-bbf2-1eb4fdcc7362 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:07.437838 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a2b0a41b-ceeb-44f6-bbf2-1eb4fdcc7362 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1807 microversion: 2.20 time: 0.155710 Sep 07 16:01:07.438379 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 326/636] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:01:07 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:01:08.462334 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ffbe796e-ce37-4a90-89d6-1eda4a91de50 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:01:08.462949 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ffbe796e-ce37-4a90-89d6-1eda4a91de50 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:01:08.469381 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ffbe796e-ce37-4a90-89d6-1eda4a91de50 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:08.469867 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ffbe796e-ce37-4a90-89d6-1eda4a91de50 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:08.470313 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ffbe796e-ce37-4a90-89d6-1eda4a91de50 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:08.471003 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ffbe796e-ce37-4a90-89d6-1eda4a91de50 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:08.471459 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ffbe796e-ce37-4a90-89d6-1eda4a91de50 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:08.471911 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ffbe796e-ce37-4a90-89d6-1eda4a91de50 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:08.599472 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-ffbe796e-ce37-4a90-89d6-1eda4a91de50 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:08.608214 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-ffbe796e-ce37-4a90-89d6-1eda4a91de50 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:08.609644 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-ffbe796e-ce37-4a90-89d6-1eda4a91de50 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:08.611288 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ffbe796e-ce37-4a90-89d6-1eda4a91de50 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1807 microversion: 2.20 time: 0.152986 Sep 07 16:01:08.611871 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 311/637] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:01:08 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:01:09.637360 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8c7c3f72-d94c-4dd0-8d3f-56c3af2f362a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:01:09.637986 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8c7c3f72-d94c-4dd0-8d3f-56c3af2f362a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:01:09.645240 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c7c3f72-d94c-4dd0-8d3f-56c3af2f362a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:09.645722 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c7c3f72-d94c-4dd0-8d3f-56c3af2f362a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:09.646161 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c7c3f72-d94c-4dd0-8d3f-56c3af2f362a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:09.646849 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c7c3f72-d94c-4dd0-8d3f-56c3af2f362a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:09.647299 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c7c3f72-d94c-4dd0-8d3f-56c3af2f362a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:09.647754 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c7c3f72-d94c-4dd0-8d3f-56c3af2f362a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:09.776185 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-8c7c3f72-d94c-4dd0-8d3f-56c3af2f362a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:09.784655 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-8c7c3f72-d94c-4dd0-8d3f-56c3af2f362a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:09.786090 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-8c7c3f72-d94c-4dd0-8d3f-56c3af2f362a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:09.787239 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8c7c3f72-d94c-4dd0-8d3f-56c3af2f362a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1807 microversion: 2.20 time: 0.154035 Sep 07 16:01:09.787833 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 327/638] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:01:09 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:01:10.020209 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-6082c9db-24a8-4e1d-bfda-c85b7cadad4b req-9c7c536b-279a-45db-881b-f54f3a52136b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "331c4dfb-7ee1-4585-bed9-2e65fa1f062a", "name": "network-vif-plugged", "status": "completed", "tag": "dcda231d-d2f5-41dc-b0c3-658f97c33345"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:01:10.030756 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-6082c9db-24a8-4e1d-bfda-c85b7cadad4b req-9c7c536b-279a-45db-881b-f54f3a52136b service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:10.031359 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-6082c9db-24a8-4e1d-bfda-c85b7cadad4b req-9c7c536b-279a-45db-881b-f54f3a52136b service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:10.031841 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-6082c9db-24a8-4e1d-bfda-c85b7cadad4b req-9c7c536b-279a-45db-881b-f54f3a52136b service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:10.046051 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-6082c9db-24a8-4e1d-bfda-c85b7cadad4b req-9c7c536b-279a-45db-881b-f54f3a52136b service nova] Creating event network-vif-plugged:dcda231d-d2f5-41dc-b0c3-658f97c33345 for instance 331c4dfb-7ee1-4585-bed9-2e65fa1f062a on hv-cinder-85331 Sep 07 16:01:10.051764 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-6082c9db-24a8-4e1d-bfda-c85b7cadad4b req-9c7c536b-279a-45db-881b-f54f3a52136b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035162 Sep 07 16:01:10.052425 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 312/639] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:01:10.811760 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7a928328-8a40-4163-af92-0a93cce9e0dd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:01:10.812367 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7a928328-8a40-4163-af92-0a93cce9e0dd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:01:10.818621 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a928328-8a40-4163-af92-0a93cce9e0dd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:10.819092 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a928328-8a40-4163-af92-0a93cce9e0dd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:10.819522 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a928328-8a40-4163-af92-0a93cce9e0dd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:10.820222 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a928328-8a40-4163-af92-0a93cce9e0dd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:10.820664 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a928328-8a40-4163-af92-0a93cce9e0dd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:10.821079 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7a928328-8a40-4163-af92-0a93cce9e0dd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:10.989558 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7a928328-8a40-4163-af92-0a93cce9e0dd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:10.998108 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7a928328-8a40-4163-af92-0a93cce9e0dd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:10.999566 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7a928328-8a40-4163-af92-0a93cce9e0dd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:11.000900 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7a928328-8a40-4163-af92-0a93cce9e0dd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1807 microversion: 2.20 time: 0.193064 Sep 07 16:01:11.001451 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 328/640] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:01:10 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1807 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 16:01:12.027267 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a11bebe8-9802-4f3c-8553-5d98566e36c4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:01:12.027982 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a11bebe8-9802-4f3c-8553-5d98566e36c4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:01:12.034030 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a11bebe8-9802-4f3c-8553-5d98566e36c4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:12.034511 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a11bebe8-9802-4f3c-8553-5d98566e36c4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:12.034942 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a11bebe8-9802-4f3c-8553-5d98566e36c4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:12.035645 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a11bebe8-9802-4f3c-8553-5d98566e36c4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:12.036097 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a11bebe8-9802-4f3c-8553-5d98566e36c4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:12.036515 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a11bebe8-9802-4f3c-8553-5d98566e36c4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:12.162336 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-a11bebe8-9802-4f3c-8553-5d98566e36c4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:12.170809 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-a11bebe8-9802-4f3c-8553-5d98566e36c4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:12.172263 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-a11bebe8-9802-4f3c-8553-5d98566e36c4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:12.173412 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a11bebe8-9802-4f3c-8553-5d98566e36c4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1807 microversion: 2.20 time: 0.150832 Sep 07 16:01:12.173963 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 313/641] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:01:12 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:01:13.198970 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ea4b7096-1745-4988-a2af-92c665c9a36b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:01:13.199528 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ea4b7096-1745-4988-a2af-92c665c9a36b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:01:13.206584 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea4b7096-1745-4988-a2af-92c665c9a36b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:13.207081 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea4b7096-1745-4988-a2af-92c665c9a36b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:13.207508 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea4b7096-1745-4988-a2af-92c665c9a36b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:13.208201 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea4b7096-1745-4988-a2af-92c665c9a36b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:13.208643 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea4b7096-1745-4988-a2af-92c665c9a36b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:13.209060 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea4b7096-1745-4988-a2af-92c665c9a36b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:13.337049 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ea4b7096-1745-4988-a2af-92c665c9a36b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:13.345538 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ea4b7096-1745-4988-a2af-92c665c9a36b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:13.346940 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ea4b7096-1745-4988-a2af-92c665c9a36b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:13.348117 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ea4b7096-1745-4988-a2af-92c665c9a36b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1807 microversion: 2.20 time: 0.153058 Sep 07 16:01:13.348659 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 329/642] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:01:13 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:01:14.373534 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-19a3b7ed-88e0-4f25-ad25-aafe76484a61 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:01:14.374177 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-19a3b7ed-88e0-4f25-ad25-aafe76484a61 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:01:14.380588 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-19a3b7ed-88e0-4f25-ad25-aafe76484a61 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:14.381131 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-19a3b7ed-88e0-4f25-ad25-aafe76484a61 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:14.381569 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-19a3b7ed-88e0-4f25-ad25-aafe76484a61 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:14.382258 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-19a3b7ed-88e0-4f25-ad25-aafe76484a61 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:14.382710 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-19a3b7ed-88e0-4f25-ad25-aafe76484a61 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:14.383131 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-19a3b7ed-88e0-4f25-ad25-aafe76484a61 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:14.510339 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-19a3b7ed-88e0-4f25-ad25-aafe76484a61 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:14.519378 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-19a3b7ed-88e0-4f25-ad25-aafe76484a61 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:14.520819 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-19a3b7ed-88e0-4f25-ad25-aafe76484a61 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:14.521968 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-19a3b7ed-88e0-4f25-ad25-aafe76484a61 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1807 microversion: 2.20 time: 0.152342 Sep 07 16:01:14.522514 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 314/643] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:01:14 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:01:15.444217 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4d120d08-1540-4afd-a3e5-29d209c7cb6c tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1859986499", "imageRef": "cfe19284-9779-46f4-b458-81d5475ec82f", "flavorRef": "452", "networks": [{"uuid": "525b0cd3-f585-4458-95a2-096aacadb034"}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:01:15.496986 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-4d120d08-1540-4afd-a3e5-29d209c7cb6c tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] validate_networks() for [('525b0cd3-f585-4458-95a2-096aacadb034', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 16:01:15.547489 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e834c6c0-1267-4e3a-838b-fab3382fa883 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:01:15.548135 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e834c6c0-1267-4e3a-838b-fab3382fa883 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:01:15.554444 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e834c6c0-1267-4e3a-838b-fab3382fa883 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:15.555134 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e834c6c0-1267-4e3a-838b-fab3382fa883 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:15.555586 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e834c6c0-1267-4e3a-838b-fab3382fa883 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:15.556273 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e834c6c0-1267-4e3a-838b-fab3382fa883 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:15.556718 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e834c6c0-1267-4e3a-838b-fab3382fa883 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:15.557178 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e834c6c0-1267-4e3a-838b-fab3382fa883 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:15.685191 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-e834c6c0-1267-4e3a-838b-fab3382fa883 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:15.687599 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:15.696894 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-e834c6c0-1267-4e3a-838b-fab3382fa883 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:15.698292 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-e834c6c0-1267-4e3a-838b-fab3382fa883 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:15.699436 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e834c6c0-1267-4e3a-838b-fab3382fa883 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1807 microversion: 2.20 time: 0.155868 Sep 07 16:01:15.700014 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 315/644] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:01:15 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 16:01:15.881416 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-4d120d08-1540-4afd-a3e5-29d209c7cb6c tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 16:01:15.881864 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-4d120d08-1540-4afd-a3e5-29d209c7cb6c tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 16:01:15.882335 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-4d120d08-1540-4afd-a3e5-29d209c7cb6c tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 16:01:15.882742 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-4d120d08-1540-4afd-a3e5-29d209c7cb6c tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 16:01:15.883150 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-4d120d08-1540-4afd-a3e5-29d209c7cb6c tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 16:01:15.891947 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d120d08-1540-4afd-a3e5-29d209c7cb6c tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:15.892423 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d120d08-1540-4afd-a3e5-29d209c7cb6c tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:15.892887 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d120d08-1540-4afd-a3e5-29d209c7cb6c tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:15.893606 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d120d08-1540-4afd-a3e5-29d209c7cb6c tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:15.894059 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d120d08-1540-4afd-a3e5-29d209c7cb6c tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:15.894481 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4d120d08-1540-4afd-a3e5-29d209c7cb6c tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:15.911249 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-4d120d08-1540-4afd-a3e5-29d209c7cb6c tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Getting quotas for project 8213db22feb041c196d02aaeac22d875. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 16:01:15.915112 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-4d120d08-1540-4afd-a3e5-29d209c7cb6c tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Getting quotas for user c2e9cc0ef8394696b127a32edd75e885 and project 8213db22feb041c196d02aaeac22d875. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 16:01:15.926234 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4d120d08-1540-4afd-a3e5-29d209c7cb6c tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 16:01:15.928501 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4d120d08-1540-4afd-a3e5-29d209c7cb6c tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cfe19284-9779-46f4-b458-81d5475ec82f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 16:01:15.975003 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4d120d08-1540-4afd-a3e5-29d209c7cb6c tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.534240 Sep 07 16:01:15.975611 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 330/645] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Sep 7 16:01:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 16:01:15.986511 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2a3e46ce-67a8-419d-bfd7-a5dbb98f132c tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:01:15.987147 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2a3e46ce-67a8-419d-bfd7-a5dbb98f132c tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:01:16.040226 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-2a3e46ce-67a8-419d-bfd7-a5dbb98f132c tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e9cc0ef8394696b127a32edd75e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8213db22feb041c196d02aaeac22d875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:16.047015 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2a3e46ce-67a8-419d-bfd7-a5dbb98f132c tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "GET /compute/v2.1/servers/9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0" status: 200 len: 1219 microversion: 2.1 time: 0.064314 Sep 07 16:01:16.047823 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 316/646] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:01:15 2022] GET /compute/v2.1/servers/9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0 => generated 1219 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:01:16.725329 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8a8ad3b9-2bc0-407a-842c-1ac12af92494 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:01:16.725968 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8a8ad3b9-2bc0-407a-842c-1ac12af92494 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:01:16.734449 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a8ad3b9-2bc0-407a-842c-1ac12af92494 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:16.734924 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a8ad3b9-2bc0-407a-842c-1ac12af92494 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:16.735354 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a8ad3b9-2bc0-407a-842c-1ac12af92494 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:16.736068 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a8ad3b9-2bc0-407a-842c-1ac12af92494 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:16.737027 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a8ad3b9-2bc0-407a-842c-1ac12af92494 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:16.737449 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8a8ad3b9-2bc0-407a-842c-1ac12af92494 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:16.864452 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-8a8ad3b9-2bc0-407a-842c-1ac12af92494 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:16.872913 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-8a8ad3b9-2bc0-407a-842c-1ac12af92494 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:16.874333 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-8a8ad3b9-2bc0-407a-842c-1ac12af92494 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:16.875549 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8a8ad3b9-2bc0-407a-842c-1ac12af92494 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1807 microversion: 2.20 time: 0.154866 Sep 07 16:01:16.876105 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 331/647] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:01:16 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:01:17.069800 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e92c67fb-da46-45c9-bfc6-662f425435f2 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:01:17.070353 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e92c67fb-da46-45c9-bfc6-662f425435f2 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:01:17.077670 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e92c67fb-da46-45c9-bfc6-662f425435f2 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:17.078163 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e92c67fb-da46-45c9-bfc6-662f425435f2 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:17.078598 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e92c67fb-da46-45c9-bfc6-662f425435f2 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:17.079288 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e92c67fb-da46-45c9-bfc6-662f425435f2 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:17.079847 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e92c67fb-da46-45c9-bfc6-662f425435f2 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:17.080275 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e92c67fb-da46-45c9-bfc6-662f425435f2 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:17.147097 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-e92c67fb-da46-45c9-bfc6-662f425435f2 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e9cc0ef8394696b127a32edd75e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8213db22feb041c196d02aaeac22d875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:17.154795 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e92c67fb-da46-45c9-bfc6-662f425435f2 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "GET /compute/v2.1/servers/9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0" status: 200 len: 1215 microversion: 2.1 time: 0.088828 Sep 07 16:01:17.165850 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 317/648] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:01:17 2022] GET /compute/v2.1/servers/9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0 => generated 1215 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:01:17.901320 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ea670944-6baa-400b-8593-c3da6b48cce8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:01:17.902615 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ea670944-6baa-400b-8593-c3da6b48cce8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:01:17.911339 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea670944-6baa-400b-8593-c3da6b48cce8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:17.911953 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea670944-6baa-400b-8593-c3da6b48cce8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:17.912571 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea670944-6baa-400b-8593-c3da6b48cce8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:17.913430 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea670944-6baa-400b-8593-c3da6b48cce8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:17.913758 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea670944-6baa-400b-8593-c3da6b48cce8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:17.914235 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ea670944-6baa-400b-8593-c3da6b48cce8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:18.144969 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ea670944-6baa-400b-8593-c3da6b48cce8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:18.153944 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ea670944-6baa-400b-8593-c3da6b48cce8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:18.155370 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ea670944-6baa-400b-8593-c3da6b48cce8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:18.156582 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ea670944-6baa-400b-8593-c3da6b48cce8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1794 microversion: 2.20 time: 0.259328 Sep 07 16:01:18.157125 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 332/649] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:01:17 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1794 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 16:01:18.179987 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b56be13d-a46b-4c59-b8ef-4621d2733ede tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:01:18.180655 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b56be13d-a46b-4c59-b8ef-4621d2733ede tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:01:18.187014 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b56be13d-a46b-4c59-b8ef-4621d2733ede tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:18.187496 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b56be13d-a46b-4c59-b8ef-4621d2733ede tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:18.187982 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b56be13d-a46b-4c59-b8ef-4621d2733ede tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:18.188815 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b56be13d-a46b-4c59-b8ef-4621d2733ede tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:18.189301 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b56be13d-a46b-4c59-b8ef-4621d2733ede tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:18.189728 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b56be13d-a46b-4c59-b8ef-4621d2733ede tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:18.253005 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-b56be13d-a46b-4c59-b8ef-4621d2733ede tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e9cc0ef8394696b127a32edd75e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8213db22feb041c196d02aaeac22d875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:18.260624 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b56be13d-a46b-4c59-b8ef-4621d2733ede tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "GET /compute/v2.1/servers/9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0" status: 200 len: 1277 microversion: 2.1 time: 0.084888 Sep 07 16:01:18.261401 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 318/650] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:01:18 2022] GET /compute/v2.1/servers/9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0 => generated 1277 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:01:19.284993 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-781fcca5-e34c-445d-9946-2efe6dfb4472 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:01:19.285974 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-781fcca5-e34c-445d-9946-2efe6dfb4472 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:01:19.292381 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-781fcca5-e34c-445d-9946-2efe6dfb4472 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:19.292856 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-781fcca5-e34c-445d-9946-2efe6dfb4472 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:19.293326 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-781fcca5-e34c-445d-9946-2efe6dfb4472 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:19.293963 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-781fcca5-e34c-445d-9946-2efe6dfb4472 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:19.294407 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-781fcca5-e34c-445d-9946-2efe6dfb4472 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:19.294825 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-781fcca5-e34c-445d-9946-2efe6dfb4472 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:19.436652 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-d5c0f4e7-1b08-4ecc-bf58-9899df6083a3 req-49ccd4fa-8f72-46aa-b9df-2a1cbc540a6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0", "tag": "fc3b1f03-ed7d-4163-8d55-ca0c06992701"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:01:19.450153 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d5c0f4e7-1b08-4ecc-bf58-9899df6083a3 req-49ccd4fa-8f72-46aa-b9df-2a1cbc540a6a service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:19.450628 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d5c0f4e7-1b08-4ecc-bf58-9899df6083a3 req-49ccd4fa-8f72-46aa-b9df-2a1cbc540a6a service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:19.451049 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-d5c0f4e7-1b08-4ecc-bf58-9899df6083a3 req-49ccd4fa-8f72-46aa-b9df-2a1cbc540a6a service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:19.463044 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-d5c0f4e7-1b08-4ecc-bf58-9899df6083a3 req-49ccd4fa-8f72-46aa-b9df-2a1cbc540a6a service nova] Creating event network-changed:fc3b1f03-ed7d-4163-8d55-ca0c06992701 for instance 9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0 on hv-cinder-85331 Sep 07 16:01:19.468144 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-d5c0f4e7-1b08-4ecc-bf58-9899df6083a3 req-49ccd4fa-8f72-46aa-b9df-2a1cbc540a6a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036078 Sep 07 16:01:19.468903 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 319/651] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 16:01:19.497397 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-781fcca5-e34c-445d-9946-2efe6dfb4472 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e9cc0ef8394696b127a32edd75e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8213db22feb041c196d02aaeac22d875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:19.505955 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-781fcca5-e34c-445d-9946-2efe6dfb4472 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "GET /compute/v2.1/servers/9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0" status: 200 len: 1319 microversion: 2.1 time: 0.225522 Sep 07 16:01:19.506517 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 333/652] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:01:19 2022] GET /compute/v2.1/servers/9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0 => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:01:20.529029 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-923e6318-1e19-4525-be67-4d2a5e3446b8 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:01:20.529643 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-923e6318-1e19-4525-be67-4d2a5e3446b8 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:01:20.536712 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-923e6318-1e19-4525-be67-4d2a5e3446b8 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:20.537190 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-923e6318-1e19-4525-be67-4d2a5e3446b8 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:20.537616 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-923e6318-1e19-4525-be67-4d2a5e3446b8 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:20.538288 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-923e6318-1e19-4525-be67-4d2a5e3446b8 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:20.538766 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-923e6318-1e19-4525-be67-4d2a5e3446b8 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:20.539186 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-923e6318-1e19-4525-be67-4d2a5e3446b8 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:20.668170 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-923e6318-1e19-4525-be67-4d2a5e3446b8 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e9cc0ef8394696b127a32edd75e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8213db22feb041c196d02aaeac22d875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:20.675637 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-923e6318-1e19-4525-be67-4d2a5e3446b8 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "GET /compute/v2.1/servers/9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0" status: 200 len: 1319 microversion: 2.1 time: 0.150855 Sep 07 16:01:20.676185 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 320/653] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:01:20 2022] GET /compute/v2.1/servers/9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:01:21.697529 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f716e5cc-5e16-4480-853d-a4c53bd511a2 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:01:21.698144 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f716e5cc-5e16-4480-853d-a4c53bd511a2 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:01:21.704693 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f716e5cc-5e16-4480-853d-a4c53bd511a2 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:21.705169 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f716e5cc-5e16-4480-853d-a4c53bd511a2 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:21.705596 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f716e5cc-5e16-4480-853d-a4c53bd511a2 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:21.706280 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f716e5cc-5e16-4480-853d-a4c53bd511a2 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:21.706727 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f716e5cc-5e16-4480-853d-a4c53bd511a2 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:21.707147 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f716e5cc-5e16-4480-853d-a4c53bd511a2 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:21.722961 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:21.839725 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f716e5cc-5e16-4480-853d-a4c53bd511a2 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e9cc0ef8394696b127a32edd75e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8213db22feb041c196d02aaeac22d875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:21.847790 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f716e5cc-5e16-4480-853d-a4c53bd511a2 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "GET /compute/v2.1/servers/9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0" status: 200 len: 1319 microversion: 2.1 time: 0.154044 Sep 07 16:01:21.848347 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 334/654] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:01:21 2022] GET /compute/v2.1/servers/9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:01:22.871119 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2c8983a8-8750-4618-907b-0cf56abf615f tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:01:22.871759 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2c8983a8-8750-4618-907b-0cf56abf615f tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:01:22.879243 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c8983a8-8750-4618-907b-0cf56abf615f tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:22.879775 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c8983a8-8750-4618-907b-0cf56abf615f tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:22.880208 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c8983a8-8750-4618-907b-0cf56abf615f tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:22.880889 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c8983a8-8750-4618-907b-0cf56abf615f tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:22.881337 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c8983a8-8750-4618-907b-0cf56abf615f tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:22.881751 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c8983a8-8750-4618-907b-0cf56abf615f tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:23.011215 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-2c8983a8-8750-4618-907b-0cf56abf615f tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e9cc0ef8394696b127a32edd75e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8213db22feb041c196d02aaeac22d875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:23.018830 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2c8983a8-8750-4618-907b-0cf56abf615f tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "GET /compute/v2.1/servers/9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0" status: 200 len: 1319 microversion: 2.1 time: 0.151793 Sep 07 16:01:23.019388 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 321/655] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:01:22 2022] GET /compute/v2.1/servers/9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:01:24.041177 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d3f15444-c813-48fa-99d2-7fe23a1c1f95 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:01:24.041897 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d3f15444-c813-48fa-99d2-7fe23a1c1f95 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:01:24.044328 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:24.049450 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3f15444-c813-48fa-99d2-7fe23a1c1f95 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:24.049926 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3f15444-c813-48fa-99d2-7fe23a1c1f95 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:24.050389 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3f15444-c813-48fa-99d2-7fe23a1c1f95 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:24.051078 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3f15444-c813-48fa-99d2-7fe23a1c1f95 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:24.051523 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3f15444-c813-48fa-99d2-7fe23a1c1f95 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:24.051967 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d3f15444-c813-48fa-99d2-7fe23a1c1f95 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:24.188356 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d3f15444-c813-48fa-99d2-7fe23a1c1f95 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e9cc0ef8394696b127a32edd75e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8213db22feb041c196d02aaeac22d875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:24.196574 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d3f15444-c813-48fa-99d2-7fe23a1c1f95 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "GET /compute/v2.1/servers/9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0" status: 200 len: 1319 microversion: 2.1 time: 0.159168 Sep 07 16:01:24.197114 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 335/656] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:01:24 2022] GET /compute/v2.1/servers/9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:01:25.218803 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c2860be5-95b1-4261-86c6-399fe8074194 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:01:25.219446 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c2860be5-95b1-4261-86c6-399fe8074194 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:01:25.226147 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c2860be5-95b1-4261-86c6-399fe8074194 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:25.226629 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c2860be5-95b1-4261-86c6-399fe8074194 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:25.227067 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c2860be5-95b1-4261-86c6-399fe8074194 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:25.227803 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c2860be5-95b1-4261-86c6-399fe8074194 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:25.228260 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c2860be5-95b1-4261-86c6-399fe8074194 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:25.228682 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c2860be5-95b1-4261-86c6-399fe8074194 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:25.354874 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-c2860be5-95b1-4261-86c6-399fe8074194 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e9cc0ef8394696b127a32edd75e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8213db22feb041c196d02aaeac22d875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:25.363172 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c2860be5-95b1-4261-86c6-399fe8074194 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "GET /compute/v2.1/servers/9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0" status: 200 len: 1319 microversion: 2.1 time: 0.148265 Sep 07 16:01:25.363768 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 322/657] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:01:25 2022] GET /compute/v2.1/servers/9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:01:26.101893 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-8863849b-f345-48bb-9c71-2bc55ae2ee12 req-25e249bc-fed9-4d0c-af40-e8e8f1f46ff0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0", "name": "network-vif-plugged", "status": "completed", "tag": "fc3b1f03-ed7d-4163-8d55-ca0c06992701"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:01:26.107177 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:26.108006 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=6 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:26.114188 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-8863849b-f345-48bb-9c71-2bc55ae2ee12 req-25e249bc-fed9-4d0c-af40-e8e8f1f46ff0 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:26.114500 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-8863849b-f345-48bb-9c71-2bc55ae2ee12 req-25e249bc-fed9-4d0c-af40-e8e8f1f46ff0 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:26.114928 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-8863849b-f345-48bb-9c71-2bc55ae2ee12 req-25e249bc-fed9-4d0c-af40-e8e8f1f46ff0 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:26.126012 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-8863849b-f345-48bb-9c71-2bc55ae2ee12 req-25e249bc-fed9-4d0c-af40-e8e8f1f46ff0 service nova] Creating event network-vif-plugged:fc3b1f03-ed7d-4163-8d55-ca0c06992701 for instance 9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0 on hv-cinder-85331 Sep 07 16:01:26.132428 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-8863849b-f345-48bb-9c71-2bc55ae2ee12 req-25e249bc-fed9-4d0c-af40-e8e8f1f46ff0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034614 Sep 07 16:01:26.133080 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 336/658] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:01:26.385519 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0c830674-1ea3-4e4f-b472-1a4770656f50 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:01:26.386112 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0c830674-1ea3-4e4f-b472-1a4770656f50 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:01:26.388136 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:26.390547 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=45 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:26.395764 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0c830674-1ea3-4e4f-b472-1a4770656f50 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:26.396250 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0c830674-1ea3-4e4f-b472-1a4770656f50 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:26.396710 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0c830674-1ea3-4e4f-b472-1a4770656f50 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:26.397405 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0c830674-1ea3-4e4f-b472-1a4770656f50 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:26.397854 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0c830674-1ea3-4e4f-b472-1a4770656f50 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:26.398275 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0c830674-1ea3-4e4f-b472-1a4770656f50 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:26.525141 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-0c830674-1ea3-4e4f-b472-1a4770656f50 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e9cc0ef8394696b127a32edd75e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8213db22feb041c196d02aaeac22d875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:26.532917 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0c830674-1ea3-4e4f-b472-1a4770656f50 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "GET /compute/v2.1/servers/9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0" status: 200 len: 1319 microversion: 2.1 time: 0.151218 Sep 07 16:01:26.533477 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 323/659] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:01:26 2022] GET /compute/v2.1/servers/9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:01:27.556367 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-aa043679-a6c2-4dbb-b7ad-e0f67894952a tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:01:27.557088 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-aa043679-a6c2-4dbb-b7ad-e0f67894952a tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:01:27.563044 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa043679-a6c2-4dbb-b7ad-e0f67894952a tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:27.563518 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa043679-a6c2-4dbb-b7ad-e0f67894952a tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:27.564470 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa043679-a6c2-4dbb-b7ad-e0f67894952a tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:27.565161 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa043679-a6c2-4dbb-b7ad-e0f67894952a tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:27.565609 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa043679-a6c2-4dbb-b7ad-e0f67894952a tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:27.566031 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aa043679-a6c2-4dbb-b7ad-e0f67894952a tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:27.697151 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-aa043679-a6c2-4dbb-b7ad-e0f67894952a tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e9cc0ef8394696b127a32edd75e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8213db22feb041c196d02aaeac22d875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:27.704660 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-aa043679-a6c2-4dbb-b7ad-e0f67894952a tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "GET /compute/v2.1/servers/9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0" status: 200 len: 1319 microversion: 2.1 time: 0.152905 Sep 07 16:01:27.705840 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 337/660] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:01:27 2022] GET /compute/v2.1/servers/9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:01:28.728510 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-70f646b6-d9b9-4977-855d-771f52bc5b3b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:01:28.729166 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-70f646b6-d9b9-4977-855d-771f52bc5b3b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:01:28.735609 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70f646b6-d9b9-4977-855d-771f52bc5b3b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:28.736098 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70f646b6-d9b9-4977-855d-771f52bc5b3b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:28.736576 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70f646b6-d9b9-4977-855d-771f52bc5b3b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:28.737262 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70f646b6-d9b9-4977-855d-771f52bc5b3b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:28.737719 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70f646b6-d9b9-4977-855d-771f52bc5b3b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:28.738141 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-70f646b6-d9b9-4977-855d-771f52bc5b3b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:28.868438 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-70f646b6-d9b9-4977-855d-771f52bc5b3b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e9cc0ef8394696b127a32edd75e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8213db22feb041c196d02aaeac22d875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:28.876100 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-70f646b6-d9b9-4977-855d-771f52bc5b3b tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "GET /compute/v2.1/servers/9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0" status: 200 len: 1319 microversion: 2.1 time: 0.151878 Sep 07 16:01:28.876671 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 324/661] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:01:28 2022] GET /compute/v2.1/servers/9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:01:29.898941 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fcd46ecb-c9d6-42e3-9770-d22c3f14f5d2 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:01:29.899586 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fcd46ecb-c9d6-42e3-9770-d22c3f14f5d2 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:01:29.905859 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fcd46ecb-c9d6-42e3-9770-d22c3f14f5d2 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:29.906335 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fcd46ecb-c9d6-42e3-9770-d22c3f14f5d2 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:29.906772 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fcd46ecb-c9d6-42e3-9770-d22c3f14f5d2 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:29.907447 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fcd46ecb-c9d6-42e3-9770-d22c3f14f5d2 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:29.907936 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fcd46ecb-c9d6-42e3-9770-d22c3f14f5d2 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:29.908352 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fcd46ecb-c9d6-42e3-9770-d22c3f14f5d2 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:30.041065 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-fcd46ecb-c9d6-42e3-9770-d22c3f14f5d2 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e9cc0ef8394696b127a32edd75e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8213db22feb041c196d02aaeac22d875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:30.048614 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fcd46ecb-c9d6-42e3-9770-d22c3f14f5d2 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "GET /compute/v2.1/servers/9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0" status: 200 len: 1507 microversion: 2.1 time: 0.153527 Sep 07 16:01:30.049165 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 338/662] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:01:29 2022] GET /compute/v2.1/servers/9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:01:30.070691 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-26304da9-77b6-40fa-a419-16a1a9105153 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "96cd7cfd-aa02-49f1-8b99-22fd99a5e0a1", "device": "/dev/sdb"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:01:30.073578 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-26304da9-77b6-40fa-a419-16a1a9105153 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:01:30.079903 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-26304da9-77b6-40fa-a419-16a1a9105153 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:30.081004 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-26304da9-77b6-40fa-a419-16a1a9105153 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:30.081439 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-26304da9-77b6-40fa-a419-16a1a9105153 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:30.082114 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-26304da9-77b6-40fa-a419-16a1a9105153 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:30.082563 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-26304da9-77b6-40fa-a419-16a1a9105153 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:30.082981 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-26304da9-77b6-40fa-a419-16a1a9105153 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:30.338638 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-26304da9-77b6-40fa-a419-16a1a9105153 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "POST /compute/v2.1/servers/9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271307 Sep 07 16:01:30.339279 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 325/663] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Sep 7 16:01:30 2022] POST /compute/v2.1/servers/9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:01:39.886240 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-04b9c9d6-e66a-4fcc-a391-638515e1577d tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:01:39.886775 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-04b9c9d6-e66a-4fcc-a391-638515e1577d tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:01:39.893719 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-04b9c9d6-e66a-4fcc-a391-638515e1577d tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:39.894204 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-04b9c9d6-e66a-4fcc-a391-638515e1577d tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:39.894634 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-04b9c9d6-e66a-4fcc-a391-638515e1577d tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:39.895310 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-04b9c9d6-e66a-4fcc-a391-638515e1577d tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:39.895800 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-04b9c9d6-e66a-4fcc-a391-638515e1577d tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:39.896222 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-04b9c9d6-e66a-4fcc-a391-638515e1577d tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:39.918414 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-04b9c9d6-e66a-4fcc-a391-638515e1577d tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14/ips" status: 200 len: 147 microversion: 2.1 time: 0.035939 Sep 07 16:01:39.918892 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 339/664] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Sep 7 16:01:39 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14/ips => generated 147 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:01:45.132570 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1ff48bd4-9936-46de-9987-d0794c979c35 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "99bc7dae-f25a-4c52-83ef-cdc45f57376d"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:01:45.135066 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1ff48bd4-9936-46de-9987-d0794c979c35 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:01:45.137652 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=4 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:45.138312 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:45.144614 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1ff48bd4-9936-46de-9987-d0794c979c35 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:45.145096 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1ff48bd4-9936-46de-9987-d0794c979c35 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:45.145525 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1ff48bd4-9936-46de-9987-d0794c979c35 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:45.146205 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1ff48bd4-9936-46de-9987-d0794c979c35 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:45.146652 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1ff48bd4-9936-46de-9987-d0794c979c35 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:45.147069 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1ff48bd4-9936-46de-9987-d0794c979c35 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:49.193565 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1ff48bd4-9936-46de-9987-d0794c979c35 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "POST /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.065046 Sep 07 16:01:49.194216 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 326/665] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Sep 7 16:01:45 2022] POST /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14/os-volume_attachments => generated 194 bytes in 4067 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:01:53.821624 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-654dcfeb-f6cd-4e90-936f-3a393810a2b9 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:01:53.822257 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-654dcfeb-f6cd-4e90-936f-3a393810a2b9 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:01:53.824787 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 16:01:53.824930 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Wed Sep 7 16:01:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0/os-volume_attachments/96cd7cfd-aa02-49f1-8b99-22fd99a5e0a1 (ip 10.222.0.17) !!! Sep 07 16:01:53.826166 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=9 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:53.826886 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=27 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:53.834475 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-654dcfeb-f6cd-4e90-936f-3a393810a2b9 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:53.835299 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-654dcfeb-f6cd-4e90-936f-3a393810a2b9 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:53.835846 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-654dcfeb-f6cd-4e90-936f-3a393810a2b9 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:53.836836 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-654dcfeb-f6cd-4e90-936f-3a393810a2b9 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:53.837314 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-654dcfeb-f6cd-4e90-936f-3a393810a2b9 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:53.838058 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-654dcfeb-f6cd-4e90-936f-3a393810a2b9 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:53.967992 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-654dcfeb-f6cd-4e90-936f-3a393810a2b9 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lazy-loading 'services' on Instance uuid 9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 16:01:54.084872 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-654dcfeb-f6cd-4e90-936f-3a393810a2b9 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0/os-volume_attachments/96cd7cfd-aa02-49f1-8b99-22fd99a5e0a1" status: 202 len: 0 microversion: 2.1 time: 0.267120 Sep 07 16:01:54.085545 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 340/666] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Sep 7 16:01:53 2022] DELETE /compute/v2.1/servers/9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0/os-volume_attachments/96cd7cfd-aa02-49f1-8b99-22fd99a5e0a1 => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 16:01:57.789697 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:57.794270 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5b5da63c-5d92-4444-81f1-294926991973 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:01:57.801804 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5b5da63c-5d92-4444-81f1-294926991973 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:57.802278 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5b5da63c-5d92-4444-81f1-294926991973 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:57.802704 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5b5da63c-5d92-4444-81f1-294926991973 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:57.862501 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5b5da63c-5d92-4444-81f1-294926991973 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Going to try to stop instance {{(pid=120641) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 07 16:01:57.904268 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5b5da63c-5d92-4444-81f1-294926991973 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "POST /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14/action" status: 202 len: 0 microversion: 2.1 time: 0.115518 Sep 07 16:01:57.904865 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 327/667] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Sep 7 16:01:57 2022] POST /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 16:01:57.914164 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a30e048a-dff2-4e81-b9a6-a665c95d169c tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:01:57.914951 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a30e048a-dff2-4e81-b9a6-a665c95d169c tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:01:57.921701 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a30e048a-dff2-4e81-b9a6-a665c95d169c tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:57.922199 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a30e048a-dff2-4e81-b9a6-a665c95d169c tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:57.922681 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a30e048a-dff2-4e81-b9a6-a665c95d169c tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:57.923898 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a30e048a-dff2-4e81-b9a6-a665c95d169c tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:57.924346 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a30e048a-dff2-4e81-b9a6-a665c95d169c tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:57.924768 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a30e048a-dff2-4e81-b9a6-a665c95d169c tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:58.303485 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a30e048a-dff2-4e81-b9a6-a665c95d169c tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:58.311596 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a30e048a-dff2-4e81-b9a6-a665c95d169c tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1726 microversion: 2.1 time: 0.401658 Sep 07 16:01:58.312149 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 341/668] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:01:57 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1726 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:01:58.382994 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2f453370-4ffc-4e97-a9da-c71288cf1aa0 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:01:58.383639 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2f453370-4ffc-4e97-a9da-c71288cf1aa0 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:01:58.390405 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f453370-4ffc-4e97-a9da-c71288cf1aa0 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:58.390891 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f453370-4ffc-4e97-a9da-c71288cf1aa0 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:58.391327 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f453370-4ffc-4e97-a9da-c71288cf1aa0 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:58.392657 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f453370-4ffc-4e97-a9da-c71288cf1aa0 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:58.393112 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f453370-4ffc-4e97-a9da-c71288cf1aa0 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:58.393537 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2f453370-4ffc-4e97-a9da-c71288cf1aa0 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:58.417967 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2f453370-4ffc-4e97-a9da-c71288cf1aa0 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 16:01:58.494029 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2f453370-4ffc-4e97-a9da-c71288cf1aa0 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0" status: 204 len: 0 microversion: 2.1 time: 0.114820 Sep 07 16:01:58.494792 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 328/669] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Sep 7 16:01:58 2022] DELETE /compute/v2.1/servers/9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 16:01:58.505262 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1242c3cb-bbb4-4f04-a485-867fa8f28245 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:01:58.506063 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1242c3cb-bbb4-4f04-a485-867fa8f28245 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:01:58.520323 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1242c3cb-bbb4-4f04-a485-867fa8f28245 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:58.520803 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1242c3cb-bbb4-4f04-a485-867fa8f28245 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:58.521236 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1242c3cb-bbb4-4f04-a485-867fa8f28245 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:58.521927 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1242c3cb-bbb4-4f04-a485-867fa8f28245 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:58.522377 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1242c3cb-bbb4-4f04-a485-867fa8f28245 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:58.522799 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1242c3cb-bbb4-4f04-a485-867fa8f28245 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:58.646267 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1242c3cb-bbb4-4f04-a485-867fa8f28245 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e9cc0ef8394696b127a32edd75e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8213db22feb041c196d02aaeac22d875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:58.653824 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1242c3cb-bbb4-4f04-a485-867fa8f28245 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "GET /compute/v2.1/servers/9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0" status: 200 len: 1513 microversion: 2.1 time: 0.154581 Sep 07 16:01:58.654373 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 342/670] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:01:58 2022] GET /compute/v2.1/servers/9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:01:59.337383 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4fa78391-8caf-4bcb-9c9b-ee5b2ae2d139 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:01:59.338073 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4fa78391-8caf-4bcb-9c9b-ee5b2ae2d139 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:01:59.344758 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4fa78391-8caf-4bcb-9c9b-ee5b2ae2d139 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:59.345260 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4fa78391-8caf-4bcb-9c9b-ee5b2ae2d139 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:59.345692 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4fa78391-8caf-4bcb-9c9b-ee5b2ae2d139 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:59.346362 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4fa78391-8caf-4bcb-9c9b-ee5b2ae2d139 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:59.346809 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4fa78391-8caf-4bcb-9c9b-ee5b2ae2d139 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:59.347221 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4fa78391-8caf-4bcb-9c9b-ee5b2ae2d139 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:59.475236 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-4fa78391-8caf-4bcb-9c9b-ee5b2ae2d139 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:59.483306 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4fa78391-8caf-4bcb-9c9b-ee5b2ae2d139 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1726 microversion: 2.1 time: 0.150125 Sep 07 16:01:59.483896 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 329/671] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:01:59 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:01:59.676869 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a50921bb-1410-4428-b3ce-67e27aac77bd tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:01:59.677382 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a50921bb-1410-4428-b3ce-67e27aac77bd tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:01:59.683718 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a50921bb-1410-4428-b3ce-67e27aac77bd tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:59.684196 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a50921bb-1410-4428-b3ce-67e27aac77bd tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:59.684627 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a50921bb-1410-4428-b3ce-67e27aac77bd tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:59.685308 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a50921bb-1410-4428-b3ce-67e27aac77bd tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:01:59.685761 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a50921bb-1410-4428-b3ce-67e27aac77bd tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:01:59.686218 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a50921bb-1410-4428-b3ce-67e27aac77bd tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:01:59.812675 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a50921bb-1410-4428-b3ce-67e27aac77bd tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e9cc0ef8394696b127a32edd75e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8213db22feb041c196d02aaeac22d875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:01:59.820320 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a50921bb-1410-4428-b3ce-67e27aac77bd tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "GET /compute/v2.1/servers/9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0" status: 200 len: 1513 microversion: 2.1 time: 0.147868 Sep 07 16:01:59.820881 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 343/672] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:01:59 2022] GET /compute/v2.1/servers/9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0 => generated 1513 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:02:00.506689 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cf5cfa18-2129-4565-874a-003f30530778 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:00.507327 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cf5cfa18-2129-4565-874a-003f30530778 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:00.514544 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf5cfa18-2129-4565-874a-003f30530778 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:00.515020 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf5cfa18-2129-4565-874a-003f30530778 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:00.515452 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf5cfa18-2129-4565-874a-003f30530778 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:00.516157 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf5cfa18-2129-4565-874a-003f30530778 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:00.516637 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf5cfa18-2129-4565-874a-003f30530778 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:00.517082 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf5cfa18-2129-4565-874a-003f30530778 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:00.648419 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-cf5cfa18-2129-4565-874a-003f30530778 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:00.656723 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cf5cfa18-2129-4565-874a-003f30530778 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1726 microversion: 2.1 time: 0.153902 Sep 07 16:02:00.657286 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 330/673] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:00 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:02:00.842711 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1f3ad3ec-2c69-44dc-bcc3-a1748eed3865 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:00.843229 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1f3ad3ec-2c69-44dc-bcc3-a1748eed3865 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:00.850375 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f3ad3ec-2c69-44dc-bcc3-a1748eed3865 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:00.850847 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f3ad3ec-2c69-44dc-bcc3-a1748eed3865 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:00.851275 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f3ad3ec-2c69-44dc-bcc3-a1748eed3865 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:00.851979 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f3ad3ec-2c69-44dc-bcc3-a1748eed3865 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:00.852431 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f3ad3ec-2c69-44dc-bcc3-a1748eed3865 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:00.852852 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1f3ad3ec-2c69-44dc-bcc3-a1748eed3865 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:01.015076 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1f3ad3ec-2c69-44dc-bcc3-a1748eed3865 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e9cc0ef8394696b127a32edd75e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8213db22feb041c196d02aaeac22d875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:01.023347 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1f3ad3ec-2c69-44dc-bcc3-a1748eed3865 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "GET /compute/v2.1/servers/9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0" status: 200 len: 1513 microversion: 2.1 time: 0.184456 Sep 07 16:02:01.023972 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 344/674] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:00 2022] GET /compute/v2.1/servers/9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0 => generated 1513 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:02:01.474239 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-9b51e72a-3e1a-4331-bc83-55fa49a11bd1 req-9f9d9da7-9bff-4d5b-b2bd-fcaa563655aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0", "name": "network-vif-deleted", "tag": "fc3b1f03-ed7d-4163-8d55-ca0c06992701"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:02:01.484038 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-9b51e72a-3e1a-4331-bc83-55fa49a11bd1 req-9f9d9da7-9bff-4d5b-b2bd-fcaa563655aa service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:01.484529 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-9b51e72a-3e1a-4331-bc83-55fa49a11bd1 req-9f9d9da7-9bff-4d5b-b2bd-fcaa563655aa service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:01.485001 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-9b51e72a-3e1a-4331-bc83-55fa49a11bd1 req-9f9d9da7-9bff-4d5b-b2bd-fcaa563655aa service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:01.497072 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-9b51e72a-3e1a-4331-bc83-55fa49a11bd1 req-9f9d9da7-9bff-4d5b-b2bd-fcaa563655aa service nova] Creating event network-vif-deleted:fc3b1f03-ed7d-4163-8d55-ca0c06992701 for instance 9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0 on hv-cinder-85331 Sep 07 16:02:01.501595 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-9b51e72a-3e1a-4331-bc83-55fa49a11bd1 req-9f9d9da7-9bff-4d5b-b2bd-fcaa563655aa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091681 Sep 07 16:02:01.502227 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 331/675] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:02:01.680086 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8c44fb16-d6dd-472e-aed3-0e535eebddeb tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:01.680689 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8c44fb16-d6dd-472e-aed3-0e535eebddeb tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:01.686538 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c44fb16-d6dd-472e-aed3-0e535eebddeb tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:01.687013 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c44fb16-d6dd-472e-aed3-0e535eebddeb tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:01.687441 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c44fb16-d6dd-472e-aed3-0e535eebddeb tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:01.688150 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c44fb16-d6dd-472e-aed3-0e535eebddeb tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:01.688597 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c44fb16-d6dd-472e-aed3-0e535eebddeb tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:01.689012 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c44fb16-d6dd-472e-aed3-0e535eebddeb tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:01.817861 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-8c44fb16-d6dd-472e-aed3-0e535eebddeb tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:01.826220 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8c44fb16-d6dd-472e-aed3-0e535eebddeb tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1726 microversion: 2.1 time: 0.149807 Sep 07 16:02:01.826868 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 345/676] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:01 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:02:02.047653 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-71e87236-21d1-48a2-9aed-1e02a4425c84 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:02.048349 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-71e87236-21d1-48a2-9aed-1e02a4425c84 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:02.054420 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-71e87236-21d1-48a2-9aed-1e02a4425c84 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:02.054899 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-71e87236-21d1-48a2-9aed-1e02a4425c84 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:02.055332 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-71e87236-21d1-48a2-9aed-1e02a4425c84 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:02.056044 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-71e87236-21d1-48a2-9aed-1e02a4425c84 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:02.056494 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-71e87236-21d1-48a2-9aed-1e02a4425c84 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:02.056912 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-71e87236-21d1-48a2-9aed-1e02a4425c84 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:02.087253 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-71e87236-21d1-48a2-9aed-1e02a4425c84 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:02.087767 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-71e87236-21d1-48a2-9aed-1e02a4425c84 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:02.088199 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-71e87236-21d1-48a2-9aed-1e02a4425c84 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:02.088637 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-71e87236-21d1-48a2-9aed-1e02a4425c84 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lazy-loading 'fault' on Instance uuid 9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 16:02:02.131995 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-71e87236-21d1-48a2-9aed-1e02a4425c84 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e9cc0ef8394696b127a32edd75e885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8213db22feb041c196d02aaeac22d875', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:02.139623 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-71e87236-21d1-48a2-9aed-1e02a4425c84 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "GET /compute/v2.1/servers/9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0" status: 200 len: 1309 microversion: 2.1 time: 0.096531 Sep 07 16:02:02.140214 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 332/677] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:02 2022] GET /compute/v2.1/servers/9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0 => generated 1309 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:02:02.850529 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c63d8873-680d-44df-93d2-1166721eff48 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:02.851188 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c63d8873-680d-44df-93d2-1166721eff48 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:02.857400 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c63d8873-680d-44df-93d2-1166721eff48 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:02.857880 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c63d8873-680d-44df-93d2-1166721eff48 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:02.858308 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c63d8873-680d-44df-93d2-1166721eff48 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:02.858980 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c63d8873-680d-44df-93d2-1166721eff48 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:02.859426 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c63d8873-680d-44df-93d2-1166721eff48 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:02.859875 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c63d8873-680d-44df-93d2-1166721eff48 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:02.990711 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c63d8873-680d-44df-93d2-1166721eff48 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:02.998714 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c63d8873-680d-44df-93d2-1166721eff48 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1726 microversion: 2.1 time: 0.152325 Sep 07 16:02:02.999259 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 346/678] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:02 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:02:03.162597 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2c17b4ae-4bab-42fa-bfe0-d040667c3045 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:03.163203 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2c17b4ae-4bab-42fa-bfe0-d040667c3045 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] [instance: 9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:03.169608 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c17b4ae-4bab-42fa-bfe0-d040667c3045 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:03.170094 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c17b4ae-4bab-42fa-bfe0-d040667c3045 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:03.170526 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c17b4ae-4bab-42fa-bfe0-d040667c3045 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:03.171210 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c17b4ae-4bab-42fa-bfe0-d040667c3045 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:03.171682 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c17b4ae-4bab-42fa-bfe0-d040667c3045 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:03.172100 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2c17b4ae-4bab-42fa-bfe0-d040667c3045 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:03.186375 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-2c17b4ae-4bab-42fa-bfe0-d040667c3045 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] HTTP exception thrown: Instance 9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0 could not be found. Sep 07 16:02:03.187985 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2c17b4ae-4bab-42fa-bfe0-d040667c3045 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Request method failure captured: Sep 07 16:02:03.187985 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0 HTTP/1.1 Sep 07 16:02:03.187985 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Accept: application/json Sep 07 16:02:03.187985 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Accept-Encoding: identity Sep 07 16:02:03.187985 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Connection: close Sep 07 16:02:03.187985 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Content-Length: 0 Sep 07 16:02:03.187985 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Content-Type: application/json Sep 07 16:02:03.187985 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Host: 10.222.0.17 Sep 07 16:02:03.187985 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Openstack-System-Scope: None Sep 07 16:02:03.187985 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Sep 07 16:02:03.187985 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjGL_F4Mi7EQLlV5UyEG5L4MpK2OSIUZj5JGM63dIMmrkVmVgaqwPzQrk2bnRVGJAHG2JUcewauNBe2rMLfj3ddjP5siG4R7iavke5O1XapuKGG-_6-HLwItFilmDQ3S--2S-NZ8i6X4-brTEkdihm3nJV2j_OC8VOht-KInUoO0d91VU Sep 07 16:02:03.187985 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Domain-Id: None Sep 07 16:02:03.187985 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Domain-Name: None Sep 07 16:02:03.187985 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Identity-Status: Confirmed Sep 07 16:02:03.187985 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Is-Admin-Project: True Sep 07 16:02:03.187985 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Domain-Id: default Sep 07 16:02:03.187985 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Domain-Name: Default Sep 07 16:02:03.187985 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Id: 8213db22feb041c196d02aaeac22d875 Sep 07 16:02:03.187985 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Name: tempest-VolumesSnapshotTestJSON-280465660 Sep 07 16:02:03.187985 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Role: reader,member Sep 07 16:02:03.187985 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Roles: reader,member Sep 07 16:02:03.189606 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8213db22feb041c196d02aaeac22d875", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8213db22feb041c196d02aaeac22d875"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8213db22feb041c196d02aaeac22d875"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8213db22feb041c196d02aaeac22d875"}]}] Sep 07 16:02:03.189606 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant: tempest-VolumesSnapshotTestJSON-280465660 Sep 07 16:02:03.189606 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant-Id: 8213db22feb041c196d02aaeac22d875 Sep 07 16:02:03.189606 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-280465660 Sep 07 16:02:03.189606 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User: tempest-VolumesSnapshotTestJSON-280465660-project Sep 07 16:02:03.189606 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Domain-Id: default Sep 07 16:02:03.189606 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Domain-Name: Default Sep 07 16:02:03.189606 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Id: c2e9cc0ef8394696b127a32edd75e885 Sep 07 16:02:03.189606 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Name: tempest-VolumesSnapshotTestJSON-280465660-project Sep 07 16:02:03.189606 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: method: > Sep 07 16:02:03.189606 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: exception: Instance 9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0 could not be found. Sep 07 16:02:03.189606 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: action_args: {'id': '9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0'} Sep 07 16:02:03.190434 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 16:02:03.190434 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:02:03.190434 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 16:02:03.190434 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 16:02:03.190434 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 16:02:03.190434 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 16:02:03.190434 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 16:02:03.190434 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 16:02:03.190434 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 16:02:03.190434 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 16:02:03.190434 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0 could not be found. Sep 07 16:02:03.190434 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:02:03.190434 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:02:03.190434 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:02:03.190434 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:02:03.190434 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:02:03.190434 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:02:03.190434 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 16:02:03.190434 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 16:02:03.190434 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 16:02:03.192123 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 16:02:03.192123 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 16:02:03.192123 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 16:02:03.192123 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 16:02:03.192123 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 16:02:03.192123 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 16:02:03.192123 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 16:02:03.192123 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0 could not be found. Sep 07 16:02:03.192123 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:02:03.192123 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:02:03.192123 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:02:03.192123 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:02:03.192123 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:02:03.192123 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:02:03.192123 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 16:02:03.192123 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 16:02:03.192123 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0 could not be found. Sep 07 16:02:03.192123 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:02:03.193455 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2c17b4ae-4bab-42fa-bfe0-d040667c3045 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] Returning 404 to user: Instance 9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 16:02:03.193455 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2c17b4ae-4bab-42fa-bfe0-d040667c3045 tempest-VolumesSnapshotTestJSON-280465660 tempest-VolumesSnapshotTestJSON-280465660-project] 10.222.0.17 "GET /compute/v2.1/servers/9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0" status: 404 len: 111 microversion: 2.1 time: 0.030661 Sep 07 16:02:03.193455 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 333/679] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:03 2022] GET /compute/v2.1/servers/9d3e2720-1ee3-4b2c-94dc-7dec9fea98d0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 16:02:04.020744 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c757ee48-415d-4ffa-bd0b-16953ef89f9b tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:04.021372 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c757ee48-415d-4ffa-bd0b-16953ef89f9b tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:04.027852 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c757ee48-415d-4ffa-bd0b-16953ef89f9b tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:04.028329 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c757ee48-415d-4ffa-bd0b-16953ef89f9b tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:04.028759 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c757ee48-415d-4ffa-bd0b-16953ef89f9b tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:04.029435 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c757ee48-415d-4ffa-bd0b-16953ef89f9b tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:04.029879 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c757ee48-415d-4ffa-bd0b-16953ef89f9b tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:04.030295 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c757ee48-415d-4ffa-bd0b-16953ef89f9b tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:04.157522 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c757ee48-415d-4ffa-bd0b-16953ef89f9b tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:04.165606 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c757ee48-415d-4ffa-bd0b-16953ef89f9b tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1726 microversion: 2.1 time: 0.148621 Sep 07 16:02:04.166161 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 347/680] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:04 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1726 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:02:05.189495 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bbdf474c-4fbd-48bb-aadc-b04e22e200f7 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:05.190107 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bbdf474c-4fbd-48bb-aadc-b04e22e200f7 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:05.196232 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bbdf474c-4fbd-48bb-aadc-b04e22e200f7 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:05.196740 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bbdf474c-4fbd-48bb-aadc-b04e22e200f7 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:05.197173 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bbdf474c-4fbd-48bb-aadc-b04e22e200f7 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:05.197857 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bbdf474c-4fbd-48bb-aadc-b04e22e200f7 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:05.198310 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bbdf474c-4fbd-48bb-aadc-b04e22e200f7 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:05.198732 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bbdf474c-4fbd-48bb-aadc-b04e22e200f7 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:05.323200 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-bbdf474c-4fbd-48bb-aadc-b04e22e200f7 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:05.331447 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bbdf474c-4fbd-48bb-aadc-b04e22e200f7 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1726 microversion: 2.1 time: 0.146221 Sep 07 16:02:05.332013 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 334/681] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:05 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1726 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:02:06.355337 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3b7eb691-a092-4797-90de-db0ecd39d2fc tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:06.356298 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3b7eb691-a092-4797-90de-db0ecd39d2fc tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:06.363167 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3b7eb691-a092-4797-90de-db0ecd39d2fc tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:06.363681 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3b7eb691-a092-4797-90de-db0ecd39d2fc tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:06.364118 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3b7eb691-a092-4797-90de-db0ecd39d2fc tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:06.364799 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3b7eb691-a092-4797-90de-db0ecd39d2fc tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:06.365248 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3b7eb691-a092-4797-90de-db0ecd39d2fc tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:06.365670 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3b7eb691-a092-4797-90de-db0ecd39d2fc tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:06.496756 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3b7eb691-a092-4797-90de-db0ecd39d2fc tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:06.505809 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3b7eb691-a092-4797-90de-db0ecd39d2fc tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1726 microversion: 2.1 time: 0.154610 Sep 07 16:02:06.506379 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 348/682] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:06 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:02:07.529593 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fb4d8fd8-eaff-47ef-a86d-2af570643d83 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:07.530123 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fb4d8fd8-eaff-47ef-a86d-2af570643d83 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:07.537747 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb4d8fd8-eaff-47ef-a86d-2af570643d83 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:07.538226 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb4d8fd8-eaff-47ef-a86d-2af570643d83 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:07.538654 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb4d8fd8-eaff-47ef-a86d-2af570643d83 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:07.539336 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb4d8fd8-eaff-47ef-a86d-2af570643d83 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:07.539816 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb4d8fd8-eaff-47ef-a86d-2af570643d83 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:07.540263 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fb4d8fd8-eaff-47ef-a86d-2af570643d83 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:07.672201 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-fb4d8fd8-eaff-47ef-a86d-2af570643d83 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:07.681238 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fb4d8fd8-eaff-47ef-a86d-2af570643d83 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1726 microversion: 2.1 time: 0.155590 Sep 07 16:02:07.681792 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 335/683] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:07 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:02:08.704423 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-562e2e49-7167-4d62-b40c-75046f5248cc tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:08.705125 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-562e2e49-7167-4d62-b40c-75046f5248cc tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:08.711702 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-562e2e49-7167-4d62-b40c-75046f5248cc tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:08.712181 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-562e2e49-7167-4d62-b40c-75046f5248cc tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:08.712614 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-562e2e49-7167-4d62-b40c-75046f5248cc tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:08.713288 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-562e2e49-7167-4d62-b40c-75046f5248cc tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:08.713735 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-562e2e49-7167-4d62-b40c-75046f5248cc tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:08.714150 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-562e2e49-7167-4d62-b40c-75046f5248cc tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:08.786553 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4aa8df45-b2ad-4d9c-8793-98c55b4aeff5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2c5475a1-db4f-42ac-8611-35f1b0a7a466"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:02:08.789010 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4aa8df45-b2ad-4d9c-8793-98c55b4aeff5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:08.798767 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4aa8df45-b2ad-4d9c-8793-98c55b4aeff5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:08.798767 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4aa8df45-b2ad-4d9c-8793-98c55b4aeff5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:08.798767 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4aa8df45-b2ad-4d9c-8793-98c55b4aeff5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:08.798767 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4aa8df45-b2ad-4d9c-8793-98c55b4aeff5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:08.799149 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4aa8df45-b2ad-4d9c-8793-98c55b4aeff5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:08.799149 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4aa8df45-b2ad-4d9c-8793-98c55b4aeff5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:08.844076 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-562e2e49-7167-4d62-b40c-75046f5248cc tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:08.853325 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-562e2e49-7167-4d62-b40c-75046f5248cc tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1726 microversion: 2.1 time: 0.153062 Sep 07 16:02:08.853890 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 336/684] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:08 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 16:02:09.072160 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4aa8df45-b2ad-4d9c-8793-98c55b4aeff5 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "POST /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.393903 Sep 07 16:02:09.072729 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 349/685] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Sep 7 16:02:08 2022] POST /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed/os-volume_attachments => generated 194 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:02:09.877768 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b2d8535f-bb37-4963-b199-3a5e5c6eeac0 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:09.878380 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b2d8535f-bb37-4963-b199-3a5e5c6eeac0 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:09.884719 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b2d8535f-bb37-4963-b199-3a5e5c6eeac0 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:09.885199 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b2d8535f-bb37-4963-b199-3a5e5c6eeac0 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:09.885633 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b2d8535f-bb37-4963-b199-3a5e5c6eeac0 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:09.886377 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b2d8535f-bb37-4963-b199-3a5e5c6eeac0 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:09.886840 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b2d8535f-bb37-4963-b199-3a5e5c6eeac0 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:09.887264 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b2d8535f-bb37-4963-b199-3a5e5c6eeac0 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:10.024305 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-b2d8535f-bb37-4963-b199-3a5e5c6eeac0 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:10.034913 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b2d8535f-bb37-4963-b199-3a5e5c6eeac0 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1726 microversion: 2.1 time: 0.161017 Sep 07 16:02:10.035740 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 337/686] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:09 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:02:11.061925 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f18ddf32-30d4-4a76-9625-1ea2a44826e8 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:11.062715 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f18ddf32-30d4-4a76-9625-1ea2a44826e8 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:11.069777 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f18ddf32-30d4-4a76-9625-1ea2a44826e8 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:11.070381 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f18ddf32-30d4-4a76-9625-1ea2a44826e8 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:11.071099 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f18ddf32-30d4-4a76-9625-1ea2a44826e8 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:11.072023 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f18ddf32-30d4-4a76-9625-1ea2a44826e8 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:11.072602 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f18ddf32-30d4-4a76-9625-1ea2a44826e8 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:11.073131 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f18ddf32-30d4-4a76-9625-1ea2a44826e8 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:11.208522 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f18ddf32-30d4-4a76-9625-1ea2a44826e8 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:11.218536 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f18ddf32-30d4-4a76-9625-1ea2a44826e8 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1726 microversion: 2.1 time: 0.161517 Sep 07 16:02:11.219302 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 350/687] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:11 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:02:12.241616 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-42257495-5911-447f-abd7-d11b181e224c tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:12.242223 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-42257495-5911-447f-abd7-d11b181e224c tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:12.248811 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-42257495-5911-447f-abd7-d11b181e224c tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:12.249324 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-42257495-5911-447f-abd7-d11b181e224c tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:12.249758 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-42257495-5911-447f-abd7-d11b181e224c tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:12.250443 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-42257495-5911-447f-abd7-d11b181e224c tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:12.251486 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-42257495-5911-447f-abd7-d11b181e224c tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:12.251933 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-42257495-5911-447f-abd7-d11b181e224c tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:12.378211 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-42257495-5911-447f-abd7-d11b181e224c tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:12.386583 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-42257495-5911-447f-abd7-d11b181e224c tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1726 microversion: 2.1 time: 0.148962 Sep 07 16:02:12.387209 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 338/688] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:12 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1726 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:02:13.409169 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ed52f416-195a-4cfa-b0f8-d27383fbffdf tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:13.409772 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ed52f416-195a-4cfa-b0f8-d27383fbffdf tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:13.416271 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed52f416-195a-4cfa-b0f8-d27383fbffdf tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:13.416812 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed52f416-195a-4cfa-b0f8-d27383fbffdf tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:13.417250 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed52f416-195a-4cfa-b0f8-d27383fbffdf tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:13.418036 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed52f416-195a-4cfa-b0f8-d27383fbffdf tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:13.418557 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed52f416-195a-4cfa-b0f8-d27383fbffdf tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:13.418976 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ed52f416-195a-4cfa-b0f8-d27383fbffdf tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:13.548277 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ed52f416-195a-4cfa-b0f8-d27383fbffdf tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:13.560987 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ed52f416-195a-4cfa-b0f8-d27383fbffdf tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1726 microversion: 2.1 time: 0.155605 Sep 07 16:02:13.561743 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 351/689] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:13 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:02:14.589122 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3a256d16-dd92-4b6a-9c04-d34ae5985fe0 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:14.589737 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3a256d16-dd92-4b6a-9c04-d34ae5985fe0 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:14.596847 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3a256d16-dd92-4b6a-9c04-d34ae5985fe0 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:14.597330 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3a256d16-dd92-4b6a-9c04-d34ae5985fe0 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:14.597768 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3a256d16-dd92-4b6a-9c04-d34ae5985fe0 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:14.598447 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3a256d16-dd92-4b6a-9c04-d34ae5985fe0 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:14.598902 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3a256d16-dd92-4b6a-9c04-d34ae5985fe0 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:14.599613 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3a256d16-dd92-4b6a-9c04-d34ae5985fe0 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:14.621545 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:02:14.730395 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-3a256d16-dd92-4b6a-9c04-d34ae5985fe0 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:14.738969 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3a256d16-dd92-4b6a-9c04-d34ae5985fe0 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1703 microversion: 2.1 time: 0.156186 Sep 07 16:02:14.739528 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 339/690] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:14 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1703 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:02:14.761404 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2a22df11-2cbc-444f-874e-c11c6442881d tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:02:14.767917 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a22df11-2cbc-444f-874e-c11c6442881d tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:14.768394 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a22df11-2cbc-444f-874e-c11c6442881d tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:14.768821 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2a22df11-2cbc-444f-874e-c11c6442881d tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:14.829566 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2a22df11-2cbc-444f-874e-c11c6442881d tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Going to try to start instance {{(pid=120640) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 07 16:02:14.873077 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2a22df11-2cbc-444f-874e-c11c6442881d tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "POST /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14/action" status: 202 len: 0 microversion: 2.1 time: 0.115323 Sep 07 16:02:14.873773 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 352/691] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Sep 7 16:02:14 2022] POST /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 16:02:14.882165 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6b7d61d0-b6db-4066-907d-de56ebb2016e tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:14.882765 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6b7d61d0-b6db-4066-907d-de56ebb2016e tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:14.888610 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6b7d61d0-b6db-4066-907d-de56ebb2016e tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:14.889085 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6b7d61d0-b6db-4066-907d-de56ebb2016e tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:14.889512 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6b7d61d0-b6db-4066-907d-de56ebb2016e tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:14.890182 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6b7d61d0-b6db-4066-907d-de56ebb2016e tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:14.890632 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6b7d61d0-b6db-4066-907d-de56ebb2016e tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:14.891052 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6b7d61d0-b6db-4066-907d-de56ebb2016e tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:15.019354 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-6b7d61d0-b6db-4066-907d-de56ebb2016e tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:15.027343 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6b7d61d0-b6db-4066-907d-de56ebb2016e tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1712 microversion: 2.1 time: 0.148895 Sep 07 16:02:15.027915 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 340/692] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:14 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1712 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:02:16.051313 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d212330e-4d26-42eb-bed6-d8b58438bcf5 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:16.052030 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d212330e-4d26-42eb-bed6-d8b58438bcf5 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:16.058026 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d212330e-4d26-42eb-bed6-d8b58438bcf5 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:16.058497 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d212330e-4d26-42eb-bed6-d8b58438bcf5 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:16.058924 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d212330e-4d26-42eb-bed6-d8b58438bcf5 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:16.059620 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d212330e-4d26-42eb-bed6-d8b58438bcf5 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:16.060066 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d212330e-4d26-42eb-bed6-d8b58438bcf5 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:16.060481 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d212330e-4d26-42eb-bed6-d8b58438bcf5 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:16.078274 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:02:16.191863 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d212330e-4d26-42eb-bed6-d8b58438bcf5 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:16.199915 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d212330e-4d26-42eb-bed6-d8b58438bcf5 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1712 microversion: 2.1 time: 0.153620 Sep 07 16:02:16.200466 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 353/693] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:16 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1712 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:02:17.222237 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-76cf5c8c-39be-4889-94b1-78590e24ca8c tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:17.222780 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-76cf5c8c-39be-4889-94b1-78590e24ca8c tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:17.229397 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-76cf5c8c-39be-4889-94b1-78590e24ca8c tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:17.229934 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-76cf5c8c-39be-4889-94b1-78590e24ca8c tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:17.230394 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-76cf5c8c-39be-4889-94b1-78590e24ca8c tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:17.231072 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-76cf5c8c-39be-4889-94b1-78590e24ca8c tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:17.231521 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-76cf5c8c-39be-4889-94b1-78590e24ca8c tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:17.231960 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-76cf5c8c-39be-4889-94b1-78590e24ca8c tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:17.355927 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-76cf5c8c-39be-4889-94b1-78590e24ca8c tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:17.364909 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-76cf5c8c-39be-4889-94b1-78590e24ca8c tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1712 microversion: 2.1 time: 0.146627 Sep 07 16:02:17.365457 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 341/694] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:17 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1712 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:02:18.388211 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-aba7b4ae-42d4-4811-8c67-fd2c74295006 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:18.388732 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-aba7b4ae-42d4-4811-8c67-fd2c74295006 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:18.395111 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aba7b4ae-42d4-4811-8c67-fd2c74295006 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:18.395636 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aba7b4ae-42d4-4811-8c67-fd2c74295006 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:18.396069 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aba7b4ae-42d4-4811-8c67-fd2c74295006 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:18.396741 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aba7b4ae-42d4-4811-8c67-fd2c74295006 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:18.397185 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aba7b4ae-42d4-4811-8c67-fd2c74295006 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:18.397602 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-aba7b4ae-42d4-4811-8c67-fd2c74295006 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:18.522436 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-aba7b4ae-42d4-4811-8c67-fd2c74295006 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:18.530501 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-aba7b4ae-42d4-4811-8c67-fd2c74295006 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1712 microversion: 2.1 time: 0.146183 Sep 07 16:02:18.531057 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 354/695] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:18 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1712 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:02:19.554627 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2bcaf860-756b-4d66-9f6d-474e6cbea0a1 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:19.555146 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2bcaf860-756b-4d66-9f6d-474e6cbea0a1 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:19.561561 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2bcaf860-756b-4d66-9f6d-474e6cbea0a1 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:19.562033 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2bcaf860-756b-4d66-9f6d-474e6cbea0a1 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:19.562459 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2bcaf860-756b-4d66-9f6d-474e6cbea0a1 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:19.563713 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2bcaf860-756b-4d66-9f6d-474e6cbea0a1 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:19.564163 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2bcaf860-756b-4d66-9f6d-474e6cbea0a1 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:19.564579 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2bcaf860-756b-4d66-9f6d-474e6cbea0a1 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:19.715847 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-2bcaf860-756b-4d66-9f6d-474e6cbea0a1 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:19.724693 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2bcaf860-756b-4d66-9f6d-474e6cbea0a1 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1712 microversion: 2.1 time: 0.173827 Sep 07 16:02:19.725918 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 342/696] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:19 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1712 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:02:20.748576 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1490e6e3-f378-4076-9838-73e7b2d6c883 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:20.749185 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1490e6e3-f378-4076-9838-73e7b2d6c883 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:20.755761 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1490e6e3-f378-4076-9838-73e7b2d6c883 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:20.756385 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1490e6e3-f378-4076-9838-73e7b2d6c883 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:20.756818 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1490e6e3-f378-4076-9838-73e7b2d6c883 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:20.757499 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1490e6e3-f378-4076-9838-73e7b2d6c883 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:20.757971 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1490e6e3-f378-4076-9838-73e7b2d6c883 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:20.758393 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1490e6e3-f378-4076-9838-73e7b2d6c883 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:20.869904 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b4a4994b-ed28-4211-b7ee-71940c54ee11 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:02:20.872214 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b4a4994b-ed28-4211-b7ee-71940c54ee11 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:20.878594 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b4a4994b-ed28-4211-b7ee-71940c54ee11 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:20.879081 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b4a4994b-ed28-4211-b7ee-71940c54ee11 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:20.879518 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b4a4994b-ed28-4211-b7ee-71940c54ee11 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:20.880275 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b4a4994b-ed28-4211-b7ee-71940c54ee11 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:20.880739 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b4a4994b-ed28-4211-b7ee-71940c54ee11 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:20.881167 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b4a4994b-ed28-4211-b7ee-71940c54ee11 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:20.894497 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1490e6e3-f378-4076-9838-73e7b2d6c883 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:20.902980 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1490e6e3-f378-4076-9838-73e7b2d6c883 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1712 microversion: 2.1 time: 0.158204 Sep 07 16:02:20.903533 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 355/697] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:20 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1712 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:02:20.904319 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-b4a4994b-ed28-4211-b7ee-71940c54ee11 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lazy-loading 'flavor' on Instance uuid 92a9f013-5f7f-442b-84d8-f61470d999ed {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 16:02:21.061724 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b4a4994b-ed28-4211-b7ee-71940c54ee11 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "POST /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed/action" status: 200 len: 32 microversion: 2.1 time: 0.195826 Sep 07 16:02:21.062320 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 343/698] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Sep 7 16:02:20 2022] POST /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed/action => generated 32 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 07 16:02:21.071880 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c95175c0-161b-4524-969a-15ae3d50ecb0 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:21.072476 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c95175c0-161b-4524-969a-15ae3d50ecb0 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:21.078329 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c95175c0-161b-4524-969a-15ae3d50ecb0 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:21.078819 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c95175c0-161b-4524-969a-15ae3d50ecb0 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:21.079250 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c95175c0-161b-4524-969a-15ae3d50ecb0 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:21.079959 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c95175c0-161b-4524-969a-15ae3d50ecb0 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:21.080404 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c95175c0-161b-4524-969a-15ae3d50ecb0 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:21.080821 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c95175c0-161b-4524-969a-15ae3d50ecb0 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:21.226834 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c95175c0-161b-4524-969a-15ae3d50ecb0 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:21.234951 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c95175c0-161b-4524-969a-15ae3d50ecb0 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed" status: 200 len: 1736 microversion: 2.1 time: 0.166894 Sep 07 16:02:21.235508 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 356/699] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:21 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:02:21.928160 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9d46ce9e-d6be-4e0d-ab90-720460363f11 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:21.928857 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9d46ce9e-d6be-4e0d-ab90-720460363f11 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:21.936461 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d46ce9e-d6be-4e0d-ab90-720460363f11 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:21.936942 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d46ce9e-d6be-4e0d-ab90-720460363f11 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:21.937559 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d46ce9e-d6be-4e0d-ab90-720460363f11 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:21.938808 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d46ce9e-d6be-4e0d-ab90-720460363f11 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:21.939274 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d46ce9e-d6be-4e0d-ab90-720460363f11 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:21.939727 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d46ce9e-d6be-4e0d-ab90-720460363f11 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:22.074522 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-9d46ce9e-d6be-4e0d-ab90-720460363f11 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:22.082862 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9d46ce9e-d6be-4e0d-ab90-720460363f11 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1716 microversion: 2.1 time: 0.158895 Sep 07 16:02:22.083425 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 344/700] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:21 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1716 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:02:22.258131 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-60a64bc3-3626-4720-8753-d1b474a5e68f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:22.258733 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-60a64bc3-3626-4720-8753-d1b474a5e68f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:22.266581 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60a64bc3-3626-4720-8753-d1b474a5e68f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:22.267055 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60a64bc3-3626-4720-8753-d1b474a5e68f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:22.267485 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60a64bc3-3626-4720-8753-d1b474a5e68f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:22.268272 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60a64bc3-3626-4720-8753-d1b474a5e68f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:22.268671 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60a64bc3-3626-4720-8753-d1b474a5e68f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:22.269239 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-60a64bc3-3626-4720-8753-d1b474a5e68f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:22.404574 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-60a64bc3-3626-4720-8753-d1b474a5e68f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:22.413205 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-60a64bc3-3626-4720-8753-d1b474a5e68f tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed" status: 200 len: 1736 microversion: 2.1 time: 0.158848 Sep 07 16:02:22.413768 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 357/701] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:22 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:02:23.438317 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4399130a-abed-4e8e-b20a-b1d688616fbe tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:23.438877 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4399130a-abed-4e8e-b20a-b1d688616fbe tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:23.445513 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4399130a-abed-4e8e-b20a-b1d688616fbe tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:23.446009 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4399130a-abed-4e8e-b20a-b1d688616fbe tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:23.446435 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4399130a-abed-4e8e-b20a-b1d688616fbe tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:23.447109 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4399130a-abed-4e8e-b20a-b1d688616fbe tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:23.447626 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4399130a-abed-4e8e-b20a-b1d688616fbe tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:23.448052 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4399130a-abed-4e8e-b20a-b1d688616fbe tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:23.575419 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-4399130a-abed-4e8e-b20a-b1d688616fbe tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:23.583999 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4399130a-abed-4e8e-b20a-b1d688616fbe tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed" status: 200 len: 1736 microversion: 2.1 time: 0.149652 Sep 07 16:02:23.584553 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 345/702] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:23 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:02:24.607690 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5b38c2a2-540b-4384-aac8-74d08edf7afe tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:24.608312 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5b38c2a2-540b-4384-aac8-74d08edf7afe tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:24.610660 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=37 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:02:24.615798 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b38c2a2-540b-4384-aac8-74d08edf7afe tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:24.616276 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b38c2a2-540b-4384-aac8-74d08edf7afe tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:24.616712 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b38c2a2-540b-4384-aac8-74d08edf7afe tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:24.617393 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b38c2a2-540b-4384-aac8-74d08edf7afe tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:24.617844 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b38c2a2-540b-4384-aac8-74d08edf7afe tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:24.618265 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b38c2a2-540b-4384-aac8-74d08edf7afe tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:24.753019 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5b38c2a2-540b-4384-aac8-74d08edf7afe tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:24.761049 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5b38c2a2-540b-4384-aac8-74d08edf7afe tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed" status: 200 len: 1736 microversion: 2.1 time: 0.157190 Sep 07 16:02:24.761628 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 358/703] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:24 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:02:25.785353 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fe0a937c-8b40-461b-bfef-004bfffd3a90 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:25.785964 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fe0a937c-8b40-461b-bfef-004bfffd3a90 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:25.792415 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fe0a937c-8b40-461b-bfef-004bfffd3a90 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:25.792897 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fe0a937c-8b40-461b-bfef-004bfffd3a90 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:25.793337 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fe0a937c-8b40-461b-bfef-004bfffd3a90 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:25.794019 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fe0a937c-8b40-461b-bfef-004bfffd3a90 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:25.794473 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fe0a937c-8b40-461b-bfef-004bfffd3a90 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:25.794897 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fe0a937c-8b40-461b-bfef-004bfffd3a90 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:25.919673 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-fe0a937c-8b40-461b-bfef-004bfffd3a90 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:25.928214 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fe0a937c-8b40-461b-bfef-004bfffd3a90 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed" status: 200 len: 1736 microversion: 2.1 time: 0.147284 Sep 07 16:02:25.928769 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 346/704] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:25 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:02:26.951579 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-44161c2d-3783-44cb-bbb8-14bd2a42e814 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:26.952203 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-44161c2d-3783-44cb-bbb8-14bd2a42e814 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:26.959194 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44161c2d-3783-44cb-bbb8-14bd2a42e814 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:26.959695 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44161c2d-3783-44cb-bbb8-14bd2a42e814 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:26.960126 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44161c2d-3783-44cb-bbb8-14bd2a42e814 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:26.960798 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44161c2d-3783-44cb-bbb8-14bd2a42e814 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:26.961240 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44161c2d-3783-44cb-bbb8-14bd2a42e814 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:26.961659 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44161c2d-3783-44cb-bbb8-14bd2a42e814 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:27.086722 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-44161c2d-3783-44cb-bbb8-14bd2a42e814 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:27.095334 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-44161c2d-3783-44cb-bbb8-14bd2a42e814 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed" status: 200 len: 1736 microversion: 2.1 time: 0.147522 Sep 07 16:02:27.095924 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 359/705] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:26 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:02:28.118698 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ef6e9c47-6ddf-45ca-9093-e999042a0e49 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:28.119229 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ef6e9c47-6ddf-45ca-9093-e999042a0e49 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:28.121706 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:02:28.127654 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ef6e9c47-6ddf-45ca-9093-e999042a0e49 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:28.128144 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ef6e9c47-6ddf-45ca-9093-e999042a0e49 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:28.128582 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ef6e9c47-6ddf-45ca-9093-e999042a0e49 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:28.129284 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ef6e9c47-6ddf-45ca-9093-e999042a0e49 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:28.129738 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ef6e9c47-6ddf-45ca-9093-e999042a0e49 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:28.130159 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ef6e9c47-6ddf-45ca-9093-e999042a0e49 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:28.256418 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-ef6e9c47-6ddf-45ca-9093-e999042a0e49 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:28.264495 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ef6e9c47-6ddf-45ca-9093-e999042a0e49 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed" status: 200 len: 1736 microversion: 2.1 time: 0.149723 Sep 07 16:02:28.265054 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 347/706] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:28 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:02:29.288169 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-79c3a5b8-aee7-4a55-8ad6-091e13b4eb26 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:29.288781 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-79c3a5b8-aee7-4a55-8ad6-091e13b4eb26 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:29.295158 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-79c3a5b8-aee7-4a55-8ad6-091e13b4eb26 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:29.295675 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-79c3a5b8-aee7-4a55-8ad6-091e13b4eb26 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:29.296114 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-79c3a5b8-aee7-4a55-8ad6-091e13b4eb26 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:29.296839 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-79c3a5b8-aee7-4a55-8ad6-091e13b4eb26 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:29.297847 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-79c3a5b8-aee7-4a55-8ad6-091e13b4eb26 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:29.298271 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-79c3a5b8-aee7-4a55-8ad6-091e13b4eb26 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:29.451325 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-79c3a5b8-aee7-4a55-8ad6-091e13b4eb26 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:29.460511 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-79c3a5b8-aee7-4a55-8ad6-091e13b4eb26 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed" status: 200 len: 1736 microversion: 2.1 time: 0.176160 Sep 07 16:02:29.461074 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 360/707] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:29 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 16:02:30.493765 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-474532eb-c504-4493-97cd-472d948bca74 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:30.494455 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-474532eb-c504-4493-97cd-472d948bca74 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:30.501645 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-474532eb-c504-4493-97cd-472d948bca74 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:30.502127 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-474532eb-c504-4493-97cd-472d948bca74 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:30.502565 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-474532eb-c504-4493-97cd-472d948bca74 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:30.503264 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-474532eb-c504-4493-97cd-472d948bca74 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:30.504144 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-474532eb-c504-4493-97cd-472d948bca74 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:30.504144 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-474532eb-c504-4493-97cd-472d948bca74 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:30.720736 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-474532eb-c504-4493-97cd-472d948bca74 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:30.729334 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-474532eb-c504-4493-97cd-472d948bca74 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed" status: 200 len: 1736 microversion: 2.1 time: 0.239444 Sep 07 16:02:30.729904 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 348/708] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:30 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed => generated 1736 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:02:31.758643 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f0d4da0a-d04d-4aa3-b0ea-612f62d1833d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:31.759630 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f0d4da0a-d04d-4aa3-b0ea-612f62d1833d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:31.766571 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0d4da0a-d04d-4aa3-b0ea-612f62d1833d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:31.767180 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0d4da0a-d04d-4aa3-b0ea-612f62d1833d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:31.767652 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0d4da0a-d04d-4aa3-b0ea-612f62d1833d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:31.768346 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0d4da0a-d04d-4aa3-b0ea-612f62d1833d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:31.768800 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0d4da0a-d04d-4aa3-b0ea-612f62d1833d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:31.769256 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0d4da0a-d04d-4aa3-b0ea-612f62d1833d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:31.898890 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f0d4da0a-d04d-4aa3-b0ea-612f62d1833d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:31.908027 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f0d4da0a-d04d-4aa3-b0ea-612f62d1833d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed" status: 200 len: 1736 microversion: 2.1 time: 0.154381 Sep 07 16:02:31.908694 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 361/709] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:31 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:02:32.934968 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-24480027-28ad-4db0-bbab-64aec16c98b2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:32.935955 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-24480027-28ad-4db0-bbab-64aec16c98b2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:32.943719 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24480027-28ad-4db0-bbab-64aec16c98b2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:32.944199 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24480027-28ad-4db0-bbab-64aec16c98b2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:32.944830 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24480027-28ad-4db0-bbab-64aec16c98b2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:32.945518 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24480027-28ad-4db0-bbab-64aec16c98b2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:32.946123 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24480027-28ad-4db0-bbab-64aec16c98b2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:32.946817 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24480027-28ad-4db0-bbab-64aec16c98b2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:33.138013 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-24480027-28ad-4db0-bbab-64aec16c98b2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:33.147459 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-24480027-28ad-4db0-bbab-64aec16c98b2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed" status: 200 len: 1736 microversion: 2.1 time: 0.219321 Sep 07 16:02:33.159566 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 349/710] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:32 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed => generated 1736 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:02:34.174166 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6d9ae9e9-e5b1-4650-979c-f90494819464 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:34.176472 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6d9ae9e9-e5b1-4650-979c-f90494819464 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:34.186931 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d9ae9e9-e5b1-4650-979c-f90494819464 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:34.187972 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d9ae9e9-e5b1-4650-979c-f90494819464 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:34.188793 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d9ae9e9-e5b1-4650-979c-f90494819464 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:34.189573 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d9ae9e9-e5b1-4650-979c-f90494819464 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:34.191187 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d9ae9e9-e5b1-4650-979c-f90494819464 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:34.192025 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6d9ae9e9-e5b1-4650-979c-f90494819464 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:34.350124 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6d9ae9e9-e5b1-4650-979c-f90494819464 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:34.360779 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6d9ae9e9-e5b1-4650-979c-f90494819464 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed" status: 200 len: 1736 microversion: 2.1 time: 0.191100 Sep 07 16:02:34.361558 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 362/711] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:34 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed => generated 1736 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:02:35.390328 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b49c0e5b-7a53-4798-9673-3ceb542892f3 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:35.391042 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b49c0e5b-7a53-4798-9673-3ceb542892f3 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:35.403320 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b49c0e5b-7a53-4798-9673-3ceb542892f3 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:35.403858 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b49c0e5b-7a53-4798-9673-3ceb542892f3 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:35.404289 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b49c0e5b-7a53-4798-9673-3ceb542892f3 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:35.404982 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b49c0e5b-7a53-4798-9673-3ceb542892f3 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:35.405430 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b49c0e5b-7a53-4798-9673-3ceb542892f3 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:35.405863 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b49c0e5b-7a53-4798-9673-3ceb542892f3 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:35.727895 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-b49c0e5b-7a53-4798-9673-3ceb542892f3 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:35.736871 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b49c0e5b-7a53-4798-9673-3ceb542892f3 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed" status: 200 len: 1736 microversion: 2.1 time: 0.354589 Sep 07 16:02:35.751967 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 350/712] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:35 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed => generated 1736 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:02:36.761693 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7e19bdc0-b595-48fc-9031-8bf89449ceee tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:36.762991 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7e19bdc0-b595-48fc-9031-8bf89449ceee tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:36.772710 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e19bdc0-b595-48fc-9031-8bf89449ceee tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:36.773210 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e19bdc0-b595-48fc-9031-8bf89449ceee tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:36.773666 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e19bdc0-b595-48fc-9031-8bf89449ceee tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:36.774737 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e19bdc0-b595-48fc-9031-8bf89449ceee tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:36.775183 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e19bdc0-b595-48fc-9031-8bf89449ceee tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:36.775793 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e19bdc0-b595-48fc-9031-8bf89449ceee tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:36.953658 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7e19bdc0-b595-48fc-9031-8bf89449ceee tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:36.963314 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7e19bdc0-b595-48fc-9031-8bf89449ceee tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed" status: 200 len: 1736 microversion: 2.1 time: 0.205344 Sep 07 16:02:36.964575 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 363/713] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:36 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed => generated 1736 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:02:37.990254 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7b81a02e-a705-46eb-a70a-c8dd77ff3cbe tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:37.990973 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7b81a02e-a705-46eb-a70a-c8dd77ff3cbe tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:37.999368 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b81a02e-a705-46eb-a70a-c8dd77ff3cbe tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:38.000190 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b81a02e-a705-46eb-a70a-c8dd77ff3cbe tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:38.000894 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b81a02e-a705-46eb-a70a-c8dd77ff3cbe tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:38.001902 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b81a02e-a705-46eb-a70a-c8dd77ff3cbe tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:38.002480 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b81a02e-a705-46eb-a70a-c8dd77ff3cbe tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:38.003958 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b81a02e-a705-46eb-a70a-c8dd77ff3cbe tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:38.307813 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-7b81a02e-a705-46eb-a70a-c8dd77ff3cbe tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:38.328933 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7b81a02e-a705-46eb-a70a-c8dd77ff3cbe tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed" status: 200 len: 1716 microversion: 2.1 time: 0.340501 Sep 07 16:02:38.329553 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 351/714] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:37 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed => generated 1716 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:02:38.479236 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2709a028-63bd-4b23-b17d-2d9dc3d1d1bf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:38.479858 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2709a028-63bd-4b23-b17d-2d9dc3d1d1bf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:38.487144 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2709a028-63bd-4b23-b17d-2d9dc3d1d1bf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:38.488021 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2709a028-63bd-4b23-b17d-2d9dc3d1d1bf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:38.488463 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2709a028-63bd-4b23-b17d-2d9dc3d1d1bf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:38.489166 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2709a028-63bd-4b23-b17d-2d9dc3d1d1bf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:38.489649 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2709a028-63bd-4b23-b17d-2d9dc3d1d1bf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:38.490261 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2709a028-63bd-4b23-b17d-2d9dc3d1d1bf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:38.595312 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-2709a028-63bd-4b23-b17d-2d9dc3d1d1bf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] HTTP exception thrown: Cannot 'detach_volume' instance 92a9f013-5f7f-442b-84d8-f61470d999ed while it is in vm_state rescued Sep 07 16:02:38.597347 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2709a028-63bd-4b23-b17d-2d9dc3d1d1bf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Request method failure captured: Sep 07 16:02:38.597347 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: request: DELETE /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed/os-volume_attachments/2c5475a1-db4f-42ac-8611-35f1b0a7a466 HTTP/1.1 Sep 07 16:02:38.597347 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept: application/json Sep 07 16:02:38.597347 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Sep 07 16:02:38.597347 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Connection: close Sep 07 16:02:38.597347 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Length: 0 Sep 07 16:02:38.597347 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Type: application/json Sep 07 16:02:38.597347 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Host: 10.222.0.17 Sep 07 16:02:38.597347 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Sep 07 16:02:38.597347 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Sep 07 16:02:38.597347 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjGL8U3olZ2_NAu3h9ENgyu4mlOOEiN-5DzVT5ll2l4CQG1Al6-WZd8sJsfCXeHe8dqFbg7WeRmYV8ndjIQ3HiKhv70Sq_aPzDk3HT2nFi-G2crlFv8gLLPy9OLuVpMJdSfFhXkgQ7qyX93ubFTTXV_nBx0wb_NUMh1jc8VKXNTsHIdKw Sep 07 16:02:38.597347 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Sep 07 16:02:38.597347 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Sep 07 16:02:38.597347 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Sep 07 16:02:38.597347 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Sep 07 16:02:38.597347 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Sep 07 16:02:38.597347 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Sep 07 16:02:38.597347 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Id: 20596aac52254a159269aa634116f080 Sep 07 16:02:38.597347 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1951895607 Sep 07 16:02:38.597347 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Role: reader,member Sep 07 16:02:38.597347 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Roles: reader,member Sep 07 16:02:38.599330 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_20596aac52254a159269aa634116f080", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/20596aac52254a159269aa634116f080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/20596aac52254a159269aa634116f080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/20596aac52254a159269aa634116f080"}]}] Sep 07 16:02:38.599330 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1951895607 Sep 07 16:02:38.599330 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Id: 20596aac52254a159269aa634116f080 Sep 07 16:02:38.599330 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1951895607 Sep 07 16:02:38.599330 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User: tempest-ServerRescueNegativeTestJSON-1951895607-project Sep 07 16:02:38.599330 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Sep 07 16:02:38.599330 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Sep 07 16:02:38.599330 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Id: 7dc84ece6eb84315b54defd89be8a95c Sep 07 16:02:38.599330 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1951895607-project Sep 07 16:02:38.599330 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: method: > Sep 07 16:02:38.599330 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: exception: Cannot 'detach_volume' instance 92a9f013-5f7f-442b-84d8-f61470d999ed while it is in vm_state rescued Sep 07 16:02:38.600254 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: action_args: {'server_id': '92a9f013-5f7f-442b-84d8-f61470d999ed', 'id': '2c5475a1-db4f-42ac-8611-35f1b0a7a466'} Sep 07 16:02:38.600254 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 16:02:38.600254 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:02:38.600254 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 07 16:02:38.600254 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 07 16:02:38.600254 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 16:02:38.600254 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 16:02:38.600254 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 07 16:02:38.600254 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 07 16:02:38.600254 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 92a9f013-5f7f-442b-84d8-f61470d999ed in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 07 16:02:38.600254 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:02:38.600254 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:02:38.600254 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:02:38.600254 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:02:38.600254 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:02:38.600254 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:02:38.600254 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 16:02:38.600254 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 16:02:38.600254 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 16:02:38.600254 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 16:02:38.602085 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 07 16:02:38.602085 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 07 16:02:38.602085 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 07 16:02:38.602085 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 07 16:02:38.602085 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 92a9f013-5f7f-442b-84d8-f61470d999ed while it is in vm_state rescued Sep 07 16:02:38.602085 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:02:38.602085 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:02:38.602085 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:02:38.602085 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:02:38.602085 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:02:38.602085 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:02:38.602085 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 16:02:38.602085 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 16:02:38.602085 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 92a9f013-5f7f-442b-84d8-f61470d999ed while it is in vm_state rescued Sep 07 16:02:38.602085 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:02:38.602085 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2709a028-63bd-4b23-b17d-2d9dc3d1d1bf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Returning 409 to user: Cannot 'detach_volume' instance 92a9f013-5f7f-442b-84d8-f61470d999ed while it is in vm_state rescued {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 16:02:38.607428 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2709a028-63bd-4b23-b17d-2d9dc3d1d1bf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "DELETE /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed/os-volume_attachments/2c5475a1-db4f-42ac-8611-35f1b0a7a466" status: 409 len: 152 microversion: 2.1 time: 0.126465 Sep 07 16:02:38.607428 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 364/715] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Sep 7 16:02:38 2022] DELETE /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed/os-volume_attachments/2c5475a1-db4f-42ac-8611-35f1b0a7a466 => generated 152 bytes in 129 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 07 16:02:38.611405 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8e772eb3-801f-4aff-909c-113e00234fc0 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:02:38.612002 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8e772eb3-801f-4aff-909c-113e00234fc0 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:38.621034 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8e772eb3-801f-4aff-909c-113e00234fc0 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:38.621537 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8e772eb3-801f-4aff-909c-113e00234fc0 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:38.621979 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8e772eb3-801f-4aff-909c-113e00234fc0 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:38.622693 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8e772eb3-801f-4aff-909c-113e00234fc0 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:38.623158 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8e772eb3-801f-4aff-909c-113e00234fc0 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:38.623833 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8e772eb3-801f-4aff-909c-113e00234fc0 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:38.721527 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8e772eb3-801f-4aff-909c-113e00234fc0 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "POST /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed/action" status: 202 len: 0 microversion: 2.1 time: 0.114176 Sep 07 16:02:38.725339 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 352/716] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Sep 7 16:02:38 2022] POST /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 16:02:38.741794 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c941b841-0652-40ca-858f-053d75df237c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:38.742813 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c941b841-0652-40ca-858f-053d75df237c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:38.760131 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c941b841-0652-40ca-858f-053d75df237c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:38.762454 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c941b841-0652-40ca-858f-053d75df237c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:38.763130 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c941b841-0652-40ca-858f-053d75df237c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:38.764134 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c941b841-0652-40ca-858f-053d75df237c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:38.764783 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c941b841-0652-40ca-858f-053d75df237c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:38.766969 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c941b841-0652-40ca-858f-053d75df237c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:39.198739 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a5559685-69ed-49de-a506-162f0e9401e2 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:02:39.201318 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a5559685-69ed-49de-a506-162f0e9401e2 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:39.208239 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5559685-69ed-49de-a506-162f0e9401e2 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:39.209203 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5559685-69ed-49de-a506-162f0e9401e2 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:39.209759 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5559685-69ed-49de-a506-162f0e9401e2 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:39.210751 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5559685-69ed-49de-a506-162f0e9401e2 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:39.211308 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5559685-69ed-49de-a506-162f0e9401e2 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:39.212035 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5559685-69ed-49de-a506-162f0e9401e2 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:39.217274 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:02:39.244437 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c941b841-0652-40ca-858f-053d75df237c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:39.256351 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c941b841-0652-40ca-858f-053d75df237c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed" status: 200 len: 1724 microversion: 2.1 time: 0.529357 Sep 07 16:02:39.260982 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 365/717] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:38 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed => generated 1724 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:02:39.334949 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a5559685-69ed-49de-a506-162f0e9401e2 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "POST /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33/action" status: 202 len: 0 microversion: 2.1 time: 0.140790 Sep 07 16:02:39.336116 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 353/718] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Sep 7 16:02:39 2022] POST /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 16:02:39.362415 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dc068543-bca5-4822-8a66-b15dccabf166 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:39.363618 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dc068543-bca5-4822-8a66-b15dccabf166 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:39.383190 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc068543-bca5-4822-8a66-b15dccabf166 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:39.383997 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc068543-bca5-4822-8a66-b15dccabf166 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:39.384656 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc068543-bca5-4822-8a66-b15dccabf166 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:39.385650 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc068543-bca5-4822-8a66-b15dccabf166 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:39.386329 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc068543-bca5-4822-8a66-b15dccabf166 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:39.387449 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dc068543-bca5-4822-8a66-b15dccabf166 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:39.698705 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-dc068543-bca5-4822-8a66-b15dccabf166 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:39.711619 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dc068543-bca5-4822-8a66-b15dccabf166 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1751 microversion: 2.1 time: 0.370865 Sep 07 16:02:39.713076 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 366/719] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:39 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1751 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:02:40.265373 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dd201968-e3af-46a7-95f3-66c2c103a7da tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Action: 'create', calling method: .version_select at 0x7ff9a5acd9d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-415497108", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6bXdBfpoun8tx6+Hd4/ClcT1lEHG5LlFFB9S7LW52E+czKH/FU5ybFDlZ17gqQtavkUGZCVoo2vXFf6QQBXv92JvYfx/xBDR7tf5WEm3/kbY9edrbSY+SLmUZRsX85Rg=="}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:02:40.282072 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.quota [None req-dd201968-e3af-46a7-95f3-66c2c103a7da tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Getting quotas for project 6ef2c5a9809b4bee95a171cf6dca4e2b. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 16:02:40.284049 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-15aab430-1ce4-4673-9b37-266a7fc3b6d6 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:40.284920 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-15aab430-1ce4-4673-9b37-266a7fc3b6d6 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:40.286284 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.quota [None req-dd201968-e3af-46a7-95f3-66c2c103a7da tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Getting quotas for user d595f32b5f2d406b9d6ce62acec1456b and project 6ef2c5a9809b4bee95a171cf6dca4e2b. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 16:02:40.291187 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15aab430-1ce4-4673-9b37-266a7fc3b6d6 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:40.291708 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15aab430-1ce4-4673-9b37-266a7fc3b6d6 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:40.292326 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15aab430-1ce4-4673-9b37-266a7fc3b6d6 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:40.293033 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15aab430-1ce4-4673-9b37-266a7fc3b6d6 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:40.293490 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15aab430-1ce4-4673-9b37-266a7fc3b6d6 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:40.293916 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-15aab430-1ce4-4673-9b37-266a7fc3b6d6 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:40.314299 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-dd201968-e3af-46a7-95f3-66c2c103a7da tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.334916 Sep 07 16:02:40.314923 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 354/720] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Sep 7 16:02:39 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:02:40.473328 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-15aab430-1ce4-4673-9b37-266a7fc3b6d6 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:40.483778 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-15aab430-1ce4-4673-9b37-266a7fc3b6d6 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed" status: 200 len: 1724 microversion: 2.1 time: 0.204202 Sep 07 16:02:40.488027 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 367/721] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:40 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed => generated 1724 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 16:02:40.738163 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0ccfef90-fbe7-4fe0-82f8-9baf5969db98 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:40.738891 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0ccfef90-fbe7-4fe0-82f8-9baf5969db98 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:40.758786 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0ccfef90-fbe7-4fe0-82f8-9baf5969db98 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:40.759556 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0ccfef90-fbe7-4fe0-82f8-9baf5969db98 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:40.760134 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0ccfef90-fbe7-4fe0-82f8-9baf5969db98 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:40.768287 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0ccfef90-fbe7-4fe0-82f8-9baf5969db98 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:40.769062 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0ccfef90-fbe7-4fe0-82f8-9baf5969db98 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:40.769745 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0ccfef90-fbe7-4fe0-82f8-9baf5969db98 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:40.992376 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-0ccfef90-fbe7-4fe0-82f8-9baf5969db98 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:41.001539 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0ccfef90-fbe7-4fe0-82f8-9baf5969db98 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1756 microversion: 2.1 time: 0.267861 Sep 07 16:02:41.002200 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 355/722] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:40 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1756 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:02:41.508231 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-79094f0c-1c89-4e71-9dde-204890d70521 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:41.508922 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-79094f0c-1c89-4e71-9dde-204890d70521 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:41.516200 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-79094f0c-1c89-4e71-9dde-204890d70521 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:41.516687 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-79094f0c-1c89-4e71-9dde-204890d70521 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:41.517125 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-79094f0c-1c89-4e71-9dde-204890d70521 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:41.517866 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-79094f0c-1c89-4e71-9dde-204890d70521 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:41.518317 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-79094f0c-1c89-4e71-9dde-204890d70521 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:41.518738 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-79094f0c-1c89-4e71-9dde-204890d70521 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:41.686113 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-79094f0c-1c89-4e71-9dde-204890d70521 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:41.694417 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-79094f0c-1c89-4e71-9dde-204890d70521 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed" status: 200 len: 1724 microversion: 2.1 time: 0.190398 Sep 07 16:02:41.694981 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 368/723] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:41 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:02:42.031246 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-91e8e258-0bf5-40f3-8678-9715468f21da tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:42.031895 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-91e8e258-0bf5-40f3-8678-9715468f21da tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:42.045145 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-91e8e258-0bf5-40f3-8678-9715468f21da tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:42.045629 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-91e8e258-0bf5-40f3-8678-9715468f21da tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:42.046065 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-91e8e258-0bf5-40f3-8678-9715468f21da tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:42.046782 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-91e8e258-0bf5-40f3-8678-9715468f21da tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:42.047248 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-91e8e258-0bf5-40f3-8678-9715468f21da tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:42.047671 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-91e8e258-0bf5-40f3-8678-9715468f21da tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:42.195845 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-91e8e258-0bf5-40f3-8678-9715468f21da tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:42.204571 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-91e8e258-0bf5-40f3-8678-9715468f21da tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1756 microversion: 2.1 time: 0.180425 Sep 07 16:02:42.205126 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 356/724] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:42 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:02:42.719106 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2f0df5ca-2046-4471-a5a0-9fc2080cd3a6 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:42.719743 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2f0df5ca-2046-4471-a5a0-9fc2080cd3a6 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:42.726755 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f0df5ca-2046-4471-a5a0-9fc2080cd3a6 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:42.727243 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f0df5ca-2046-4471-a5a0-9fc2080cd3a6 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:42.727711 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f0df5ca-2046-4471-a5a0-9fc2080cd3a6 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:42.728430 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f0df5ca-2046-4471-a5a0-9fc2080cd3a6 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:42.728903 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f0df5ca-2046-4471-a5a0-9fc2080cd3a6 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:42.729305 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2f0df5ca-2046-4471-a5a0-9fc2080cd3a6 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:42.871257 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2f0df5ca-2046-4471-a5a0-9fc2080cd3a6 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:42.879624 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2f0df5ca-2046-4471-a5a0-9fc2080cd3a6 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed" status: 200 len: 1724 microversion: 2.1 time: 0.165019 Sep 07 16:02:42.880397 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 369/725] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:42 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:02:43.232022 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-720f8040-ad9e-4a2c-ba8e-7627e45e9e81 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:43.232636 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-720f8040-ad9e-4a2c-ba8e-7627e45e9e81 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:43.246443 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-720f8040-ad9e-4a2c-ba8e-7627e45e9e81 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:43.246995 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-720f8040-ad9e-4a2c-ba8e-7627e45e9e81 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:43.247446 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-720f8040-ad9e-4a2c-ba8e-7627e45e9e81 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:43.248171 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-720f8040-ad9e-4a2c-ba8e-7627e45e9e81 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:43.248634 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-720f8040-ad9e-4a2c-ba8e-7627e45e9e81 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:43.249058 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-720f8040-ad9e-4a2c-ba8e-7627e45e9e81 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:43.407508 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-720f8040-ad9e-4a2c-ba8e-7627e45e9e81 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:43.423312 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-720f8040-ad9e-4a2c-ba8e-7627e45e9e81 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1756 microversion: 2.1 time: 0.197418 Sep 07 16:02:43.433586 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 357/726] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:43 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1756 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:02:43.902330 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d370ea1f-6260-4005-8b03-d7a0e1b7af2b tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:43.902936 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d370ea1f-6260-4005-8b03-d7a0e1b7af2b tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:43.910955 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d370ea1f-6260-4005-8b03-d7a0e1b7af2b tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:43.911448 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d370ea1f-6260-4005-8b03-d7a0e1b7af2b tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:43.911916 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d370ea1f-6260-4005-8b03-d7a0e1b7af2b tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:43.912622 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d370ea1f-6260-4005-8b03-d7a0e1b7af2b tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:43.913078 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d370ea1f-6260-4005-8b03-d7a0e1b7af2b tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:43.913501 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d370ea1f-6260-4005-8b03-d7a0e1b7af2b tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:43.917887 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:02:44.072598 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d370ea1f-6260-4005-8b03-d7a0e1b7af2b tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:44.082098 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d370ea1f-6260-4005-8b03-d7a0e1b7af2b tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed" status: 200 len: 1724 microversion: 2.1 time: 0.183630 Sep 07 16:02:44.082776 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 370/727] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:43 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:02:44.448367 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-92c5e4bb-b700-4ed4-8839-0a02d81be883 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:44.448883 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-92c5e4bb-b700-4ed4-8839-0a02d81be883 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:44.455761 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-92c5e4bb-b700-4ed4-8839-0a02d81be883 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:44.456246 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-92c5e4bb-b700-4ed4-8839-0a02d81be883 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:44.456790 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-92c5e4bb-b700-4ed4-8839-0a02d81be883 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:44.457590 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-92c5e4bb-b700-4ed4-8839-0a02d81be883 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:44.458204 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-92c5e4bb-b700-4ed4-8839-0a02d81be883 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:44.458662 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-92c5e4bb-b700-4ed4-8839-0a02d81be883 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:44.609592 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-92c5e4bb-b700-4ed4-8839-0a02d81be883 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:44.617684 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-92c5e4bb-b700-4ed4-8839-0a02d81be883 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1756 microversion: 2.1 time: 0.173336 Sep 07 16:02:44.618232 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 358/728] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:44 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:02:45.106511 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-583a867f-b7f7-48f5-a650-23bc015a85e9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:45.108085 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-583a867f-b7f7-48f5-a650-23bc015a85e9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:45.120001 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-583a867f-b7f7-48f5-a650-23bc015a85e9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:45.120770 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-583a867f-b7f7-48f5-a650-23bc015a85e9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:45.121328 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-583a867f-b7f7-48f5-a650-23bc015a85e9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:45.121907 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-583a867f-b7f7-48f5-a650-23bc015a85e9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:45.122363 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-583a867f-b7f7-48f5-a650-23bc015a85e9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:45.122789 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-583a867f-b7f7-48f5-a650-23bc015a85e9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:45.249953 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-583a867f-b7f7-48f5-a650-23bc015a85e9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:45.257986 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-583a867f-b7f7-48f5-a650-23bc015a85e9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed" status: 200 len: 1730 microversion: 2.1 time: 0.155738 Sep 07 16:02:45.258539 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 371/729] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:45 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:02:45.281817 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9f29f816-81ba-4023-8bcf-f7e1fd6d671a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:45.282223 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9f29f816-81ba-4023-8bcf-f7e1fd6d671a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:45.288132 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9f29f816-81ba-4023-8bcf-f7e1fd6d671a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:45.288612 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9f29f816-81ba-4023-8bcf-f7e1fd6d671a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:45.289040 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9f29f816-81ba-4023-8bcf-f7e1fd6d671a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:45.289716 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9f29f816-81ba-4023-8bcf-f7e1fd6d671a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:45.290170 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9f29f816-81ba-4023-8bcf-f7e1fd6d671a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:45.290582 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9f29f816-81ba-4023-8bcf-f7e1fd6d671a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:45.368150 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9f29f816-81ba-4023-8bcf-f7e1fd6d671a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090699 Sep 07 16:02:45.368711 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 359/730] 10.222.0.17 () {58 vars in 1275 bytes} [Wed Sep 7 16:02:45 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:02:45.642203 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-05189adf-62cc-41c4-bd70-8d7938510ca1 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:45.642875 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-05189adf-62cc-41c4-bd70-8d7938510ca1 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:45.648677 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-05189adf-62cc-41c4-bd70-8d7938510ca1 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:45.649176 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-05189adf-62cc-41c4-bd70-8d7938510ca1 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:45.649647 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-05189adf-62cc-41c4-bd70-8d7938510ca1 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:45.650341 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-05189adf-62cc-41c4-bd70-8d7938510ca1 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:45.650799 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-05189adf-62cc-41c4-bd70-8d7938510ca1 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:45.651216 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-05189adf-62cc-41c4-bd70-8d7938510ca1 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:45.803104 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-05189adf-62cc-41c4-bd70-8d7938510ca1 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:45.811407 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-05189adf-62cc-41c4-bd70-8d7938510ca1 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1756 microversion: 2.1 time: 0.173661 Sep 07 16:02:45.812563 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 372/731] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:45 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:02:46.719100 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-e18016c7-cff6-4c5c-81a9-dc0ed6ceefd3 req-e1d6eeae-7589-4789-94e8-0a1725522f08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92a9f013-5f7f-442b-84d8-f61470d999ed", "tag": "a060693c-99c1-4033-a3a8-1384e673c07a"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:02:46.729725 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e18016c7-cff6-4c5c-81a9-dc0ed6ceefd3 req-e1d6eeae-7589-4789-94e8-0a1725522f08 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:46.730387 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e18016c7-cff6-4c5c-81a9-dc0ed6ceefd3 req-e1d6eeae-7589-4789-94e8-0a1725522f08 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:46.730821 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e18016c7-cff6-4c5c-81a9-dc0ed6ceefd3 req-e1d6eeae-7589-4789-94e8-0a1725522f08 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:46.742087 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-e18016c7-cff6-4c5c-81a9-dc0ed6ceefd3 req-e1d6eeae-7589-4789-94e8-0a1725522f08 service nova] Creating event network-changed:a060693c-99c1-4033-a3a8-1384e673c07a for instance 92a9f013-5f7f-442b-84d8-f61470d999ed on hv-cinder-85331 Sep 07 16:02:46.747117 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-e18016c7-cff6-4c5c-81a9-dc0ed6ceefd3 req-e1d6eeae-7589-4789-94e8-0a1725522f08 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094494 Sep 07 16:02:46.747946 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 360/732] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:02:46.836696 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-54600140-72f5-4fa2-b92d-8d7936bd117c tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:46.837300 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-54600140-72f5-4fa2-b92d-8d7936bd117c tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:46.844370 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-54600140-72f5-4fa2-b92d-8d7936bd117c tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:46.845079 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-54600140-72f5-4fa2-b92d-8d7936bd117c tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:46.845730 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-54600140-72f5-4fa2-b92d-8d7936bd117c tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:46.846580 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-54600140-72f5-4fa2-b92d-8d7936bd117c tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:46.847034 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-54600140-72f5-4fa2-b92d-8d7936bd117c tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:46.847453 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-54600140-72f5-4fa2-b92d-8d7936bd117c tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:47.008865 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-54600140-72f5-4fa2-b92d-8d7936bd117c tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:47.019689 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-54600140-72f5-4fa2-b92d-8d7936bd117c tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1756 microversion: 2.1 time: 0.186477 Sep 07 16:02:47.020842 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 373/733] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:46 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1756 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:02:48.048106 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ee9818b1-a519-46aa-8b83-a777c49e8aa8 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:48.048818 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ee9818b1-a519-46aa-8b83-a777c49e8aa8 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:48.055021 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ee9818b1-a519-46aa-8b83-a777c49e8aa8 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:48.055504 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ee9818b1-a519-46aa-8b83-a777c49e8aa8 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:48.055976 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ee9818b1-a519-46aa-8b83-a777c49e8aa8 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:48.056671 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ee9818b1-a519-46aa-8b83-a777c49e8aa8 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:48.057128 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ee9818b1-a519-46aa-8b83-a777c49e8aa8 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:48.057550 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ee9818b1-a519-46aa-8b83-a777c49e8aa8 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:48.207702 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-ee9818b1-a519-46aa-8b83-a777c49e8aa8 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:48.215943 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ee9818b1-a519-46aa-8b83-a777c49e8aa8 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1756 microversion: 2.1 time: 0.173124 Sep 07 16:02:48.216495 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 361/734] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:48 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:02:48.761696 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-71999ec7-8cb8-48d9-8596-e7d65c3ec68f req-89a68917-e7ee-40bf-b351-3cab8ce69203 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92a9f013-5f7f-442b-84d8-f61470d999ed", "tag": "a060693c-99c1-4033-a3a8-1384e673c07a"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:02:48.772645 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-71999ec7-8cb8-48d9-8596-e7d65c3ec68f req-89a68917-e7ee-40bf-b351-3cab8ce69203 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:48.773111 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-71999ec7-8cb8-48d9-8596-e7d65c3ec68f req-89a68917-e7ee-40bf-b351-3cab8ce69203 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:48.773536 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-71999ec7-8cb8-48d9-8596-e7d65c3ec68f req-89a68917-e7ee-40bf-b351-3cab8ce69203 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:48.785032 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-71999ec7-8cb8-48d9-8596-e7d65c3ec68f req-89a68917-e7ee-40bf-b351-3cab8ce69203 service nova] Creating event network-changed:a060693c-99c1-4033-a3a8-1384e673c07a for instance 92a9f013-5f7f-442b-84d8-f61470d999ed on hv-cinder-85331 Sep 07 16:02:48.789630 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-71999ec7-8cb8-48d9-8596-e7d65c3ec68f req-89a68917-e7ee-40bf-b351-3cab8ce69203 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031605 Sep 07 16:02:48.790208 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 374/735] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:02:49.240617 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-694c9b72-6664-4949-a3a1-ebffabaf66f3 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:49.241231 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-694c9b72-6664-4949-a3a1-ebffabaf66f3 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:49.248066 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-694c9b72-6664-4949-a3a1-ebffabaf66f3 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:49.248549 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-694c9b72-6664-4949-a3a1-ebffabaf66f3 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:49.248982 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-694c9b72-6664-4949-a3a1-ebffabaf66f3 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:49.250246 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-694c9b72-6664-4949-a3a1-ebffabaf66f3 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:49.250698 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-694c9b72-6664-4949-a3a1-ebffabaf66f3 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:49.251118 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-694c9b72-6664-4949-a3a1-ebffabaf66f3 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:49.456473 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-694c9b72-6664-4949-a3a1-ebffabaf66f3 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:49.466821 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-694c9b72-6664-4949-a3a1-ebffabaf66f3 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1756 microversion: 2.1 time: 0.229998 Sep 07 16:02:49.467399 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 362/736] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:49 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1756 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:02:50.492951 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-80a8ae08-aa2b-4c40-a444-0a3cc6bdb792 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:50.493568 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-80a8ae08-aa2b-4c40-a444-0a3cc6bdb792 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:50.500330 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80a8ae08-aa2b-4c40-a444-0a3cc6bdb792 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:50.500807 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80a8ae08-aa2b-4c40-a444-0a3cc6bdb792 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:50.501241 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80a8ae08-aa2b-4c40-a444-0a3cc6bdb792 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:50.501916 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80a8ae08-aa2b-4c40-a444-0a3cc6bdb792 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:50.502366 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80a8ae08-aa2b-4c40-a444-0a3cc6bdb792 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:50.502785 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80a8ae08-aa2b-4c40-a444-0a3cc6bdb792 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:50.649792 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-80a8ae08-aa2b-4c40-a444-0a3cc6bdb792 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:50.659777 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-80a8ae08-aa2b-4c40-a444-0a3cc6bdb792 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1756 microversion: 2.1 time: 0.171158 Sep 07 16:02:50.660843 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 375/737] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:50 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:02:51.256314 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-19f2d686-d504-49a8-aad8-a92d98385f52 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:51.256867 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-19f2d686-d504-49a8-aad8-a92d98385f52 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:51.259179 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=4 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:02:51.265896 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-19f2d686-d504-49a8-aad8-a92d98385f52 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:51.266427 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-19f2d686-d504-49a8-aad8-a92d98385f52 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:51.266883 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-19f2d686-d504-49a8-aad8-a92d98385f52 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:51.267662 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-19f2d686-d504-49a8-aad8-a92d98385f52 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:51.268134 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-19f2d686-d504-49a8-aad8-a92d98385f52 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:51.268556 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-19f2d686-d504-49a8-aad8-a92d98385f52 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:51.298287 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-19f2d686-d504-49a8-aad8-a92d98385f52 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a/os-volume_attachments/08fc30f7-7c9f-49dd-ad34-052fd90c0204" status: 200 len: 194 microversion: 2.20 time: 0.045827 Sep 07 16:02:51.298855 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 363/738] 10.222.0.17 () {60 vars in 1454 bytes} [Wed Sep 7 16:02:51 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a/os-volume_attachments/08fc30f7-7c9f-49dd-ad34-052fd90c0204 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 16:02:51.371655 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6672973c-a6f7-499f-ba05-ab6ab5a468c0 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:51.372158 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6672973c-a6f7-499f-ba05-ab6ab5a468c0 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:51.378170 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6672973c-a6f7-499f-ba05-ab6ab5a468c0 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:51.378656 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6672973c-a6f7-499f-ba05-ab6ab5a468c0 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:51.379093 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6672973c-a6f7-499f-ba05-ab6ab5a468c0 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:51.379817 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6672973c-a6f7-499f-ba05-ab6ab5a468c0 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:51.380269 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6672973c-a6f7-499f-ba05-ab6ab5a468c0 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:51.380698 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6672973c-a6f7-499f-ba05-ab6ab5a468c0 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:51.467186 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-6672973c-a6f7-499f-ba05-ab6ab5a468c0 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lazy-loading 'services' on Instance uuid 331c4dfb-7ee1-4585-bed9-2e65fa1f062a {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 16:02:51.538422 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6672973c-a6f7-499f-ba05-ab6ab5a468c0 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "DELETE /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a/os-volume_attachments/08fc30f7-7c9f-49dd-ad34-052fd90c0204" status: 202 len: 0 microversion: 2.20 time: 0.170475 Sep 07 16:02:51.539401 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 376/739] 10.222.0.17 () {60 vars in 1457 bytes} [Wed Sep 7 16:02:51 2022] DELETE /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a/os-volume_attachments/08fc30f7-7c9f-49dd-ad34-052fd90c0204 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 16:02:51.548485 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7aa41e54-98b2-42d5-9a0b-133173179720 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:51.551701 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7aa41e54-98b2-42d5-9a0b-133173179720 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:51.557817 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7aa41e54-98b2-42d5-9a0b-133173179720 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:51.558341 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7aa41e54-98b2-42d5-9a0b-133173179720 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:51.558846 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7aa41e54-98b2-42d5-9a0b-133173179720 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:51.559500 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7aa41e54-98b2-42d5-9a0b-133173179720 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:51.560063 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7aa41e54-98b2-42d5-9a0b-133173179720 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:51.560546 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7aa41e54-98b2-42d5-9a0b-133173179720 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:51.591975 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7aa41e54-98b2-42d5-9a0b-133173179720 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047396 Sep 07 16:02:51.592806 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 364/740] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Sep 7 16:02:51 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 16:02:51.688238 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-54ab86b0-bb7c-448d-a61e-b65e4ff9643b tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:51.689233 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-54ab86b0-bb7c-448d-a61e-b65e4ff9643b tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:51.695742 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-54ab86b0-bb7c-448d-a61e-b65e4ff9643b tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:51.696239 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-54ab86b0-bb7c-448d-a61e-b65e4ff9643b tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:51.696675 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-54ab86b0-bb7c-448d-a61e-b65e4ff9643b tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:51.697365 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-54ab86b0-bb7c-448d-a61e-b65e4ff9643b tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:51.697818 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-54ab86b0-bb7c-448d-a61e-b65e4ff9643b tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:51.698240 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-54ab86b0-bb7c-448d-a61e-b65e4ff9643b tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:51.845053 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-54ab86b0-bb7c-448d-a61e-b65e4ff9643b tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:51.853790 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-54ab86b0-bb7c-448d-a61e-b65e4ff9643b tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1756 microversion: 2.1 time: 0.171239 Sep 07 16:02:51.854354 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 377/741] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:51 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:02:52.605056 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-de606cb7-62a6-42d4-800f-dd18d91c4801 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:52.607214 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-de606cb7-62a6-42d4-800f-dd18d91c4801 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:52.614011 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de606cb7-62a6-42d4-800f-dd18d91c4801 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:52.614631 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de606cb7-62a6-42d4-800f-dd18d91c4801 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:52.615166 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de606cb7-62a6-42d4-800f-dd18d91c4801 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:52.615904 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de606cb7-62a6-42d4-800f-dd18d91c4801 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:52.616351 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de606cb7-62a6-42d4-800f-dd18d91c4801 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:52.616904 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-de606cb7-62a6-42d4-800f-dd18d91c4801 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:52.647445 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-de606cb7-62a6-42d4-800f-dd18d91c4801 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046345 Sep 07 16:02:52.648119 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 365/742] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Sep 7 16:02:52 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 16:02:52.877966 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0577844b-b920-44d5-8f4f-c8790223079c tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:52.878497 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0577844b-b920-44d5-8f4f-c8790223079c tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:52.885163 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0577844b-b920-44d5-8f4f-c8790223079c tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:52.885652 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0577844b-b920-44d5-8f4f-c8790223079c tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:52.886094 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0577844b-b920-44d5-8f4f-c8790223079c tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:52.886786 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0577844b-b920-44d5-8f4f-c8790223079c tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:52.887240 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0577844b-b920-44d5-8f4f-c8790223079c tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:52.887701 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0577844b-b920-44d5-8f4f-c8790223079c tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:53.033488 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-0577844b-b920-44d5-8f4f-c8790223079c tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:53.041636 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0577844b-b920-44d5-8f4f-c8790223079c tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1756 microversion: 2.1 time: 0.168110 Sep 07 16:02:53.042233 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 378/743] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:52 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:02:53.660653 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b005c55e-c79c-41b4-aa25-aaf117140488 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:53.662789 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b005c55e-c79c-41b4-aa25-aaf117140488 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:53.669089 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b005c55e-c79c-41b4-aa25-aaf117140488 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:53.669560 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b005c55e-c79c-41b4-aa25-aaf117140488 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:53.669984 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b005c55e-c79c-41b4-aa25-aaf117140488 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:53.670657 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b005c55e-c79c-41b4-aa25-aaf117140488 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:53.671650 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b005c55e-c79c-41b4-aa25-aaf117140488 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:53.672075 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b005c55e-c79c-41b4-aa25-aaf117140488 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:53.701096 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b005c55e-c79c-41b4-aa25-aaf117140488 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044356 Sep 07 16:02:53.701644 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 366/744] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Sep 7 16:02:53 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:02:53.764332 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ca1efeba-977f-42dc-b4f0-25787a6cae0b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:53.764783 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ca1efeba-977f-42dc-b4f0-25787a6cae0b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:53.770507 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca1efeba-977f-42dc-b4f0-25787a6cae0b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:53.770979 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca1efeba-977f-42dc-b4f0-25787a6cae0b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:53.771404 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca1efeba-977f-42dc-b4f0-25787a6cae0b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:53.772104 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca1efeba-977f-42dc-b4f0-25787a6cae0b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:53.772549 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca1efeba-977f-42dc-b4f0-25787a6cae0b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:53.773004 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca1efeba-977f-42dc-b4f0-25787a6cae0b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:53.797660 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ca1efeba-977f-42dc-b4f0-25787a6cae0b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 16:02:53.870857 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ca1efeba-977f-42dc-b4f0-25787a6cae0b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "DELETE /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 204 len: 0 microversion: 2.20 time: 0.110095 Sep 07 16:02:53.871690 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 379/745] 10.222.0.17 () {60 vars in 1280 bytes} [Wed Sep 7 16:02:53 2022] DELETE /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 16:02:53.879996 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-18f26188-2d91-480a-9635-0676d676f180 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:53.880604 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-18f26188-2d91-480a-9635-0676d676f180 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:53.886447 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-18f26188-2d91-480a-9635-0676d676f180 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:53.886928 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-18f26188-2d91-480a-9635-0676d676f180 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:53.887360 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-18f26188-2d91-480a-9635-0676d676f180 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:53.888138 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-18f26188-2d91-480a-9635-0676d676f180 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:53.888551 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-18f26188-2d91-480a-9635-0676d676f180 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:53.888973 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-18f26188-2d91-480a-9635-0676d676f180 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:54.015969 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-18f26188-2d91-480a-9635-0676d676f180 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:54.023941 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-18f26188-2d91-480a-9635-0676d676f180 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:54.025363 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-18f26188-2d91-480a-9635-0676d676f180 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:54.026513 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-18f26188-2d91-480a-9635-0676d676f180 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1722 microversion: 2.20 time: 0.150424 Sep 07 16:02:54.027059 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 367/746] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:02:53 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:02:54.065810 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f09ef562-c3d1-4293-8776-be8a6ff55b6e tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:54.066537 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f09ef562-c3d1-4293-8776-be8a6ff55b6e tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:54.072883 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f09ef562-c3d1-4293-8776-be8a6ff55b6e tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:54.073371 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f09ef562-c3d1-4293-8776-be8a6ff55b6e tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:54.073795 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f09ef562-c3d1-4293-8776-be8a6ff55b6e tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:54.074474 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f09ef562-c3d1-4293-8776-be8a6ff55b6e tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:54.074922 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f09ef562-c3d1-4293-8776-be8a6ff55b6e tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:54.075343 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f09ef562-c3d1-4293-8776-be8a6ff55b6e tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:54.216848 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f09ef562-c3d1-4293-8776-be8a6ff55b6e tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:54.225878 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f09ef562-c3d1-4293-8776-be8a6ff55b6e tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1756 microversion: 2.1 time: 0.164418 Sep 07 16:02:54.226556 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 380/747] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:54 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:02:55.053527 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c268dd29-38d4-4fd9-9d7a-382e34bff65e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:55.054287 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c268dd29-38d4-4fd9-9d7a-382e34bff65e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:55.062292 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c268dd29-38d4-4fd9-9d7a-382e34bff65e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:55.062936 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c268dd29-38d4-4fd9-9d7a-382e34bff65e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:55.063690 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c268dd29-38d4-4fd9-9d7a-382e34bff65e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:55.064913 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c268dd29-38d4-4fd9-9d7a-382e34bff65e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:55.065732 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c268dd29-38d4-4fd9-9d7a-382e34bff65e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:55.066713 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c268dd29-38d4-4fd9-9d7a-382e34bff65e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:55.208526 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-c268dd29-38d4-4fd9-9d7a-382e34bff65e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:55.216416 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-c268dd29-38d4-4fd9-9d7a-382e34bff65e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:55.217826 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-c268dd29-38d4-4fd9-9d7a-382e34bff65e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:55.218968 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c268dd29-38d4-4fd9-9d7a-382e34bff65e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1722 microversion: 2.20 time: 0.169893 Sep 07 16:02:55.219513 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 368/748] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:02:55 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 16:02:55.251714 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-50763db2-c820-495f-805d-9a71acbe3735 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:55.252317 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-50763db2-c820-495f-805d-9a71acbe3735 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:55.254751 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:02:55.260000 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50763db2-c820-495f-805d-9a71acbe3735 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:55.260481 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50763db2-c820-495f-805d-9a71acbe3735 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:55.260912 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50763db2-c820-495f-805d-9a71acbe3735 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:55.261590 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50763db2-c820-495f-805d-9a71acbe3735 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:55.262035 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50763db2-c820-495f-805d-9a71acbe3735 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:55.262451 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-50763db2-c820-495f-805d-9a71acbe3735 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:55.404751 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-50763db2-c820-495f-805d-9a71acbe3735 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:55.413526 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-50763db2-c820-495f-805d-9a71acbe3735 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1756 microversion: 2.1 time: 0.166131 Sep 07 16:02:55.414035 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 381/749] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:55 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 16:02:56.244377 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-018952d2-2e1d-46f6-bf34-fd2365bae85d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:56.244984 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-018952d2-2e1d-46f6-bf34-fd2365bae85d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:56.251895 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-018952d2-2e1d-46f6-bf34-fd2365bae85d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:56.252380 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-018952d2-2e1d-46f6-bf34-fd2365bae85d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:56.252814 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-018952d2-2e1d-46f6-bf34-fd2365bae85d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:56.253502 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-018952d2-2e1d-46f6-bf34-fd2365bae85d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:56.253978 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-018952d2-2e1d-46f6-bf34-fd2365bae85d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:56.254401 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-018952d2-2e1d-46f6-bf34-fd2365bae85d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:56.436346 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7ef707c1-c746-4565-9311-9ee2289aae85 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:56.437046 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7ef707c1-c746-4565-9311-9ee2289aae85 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:56.443460 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ef707c1-c746-4565-9311-9ee2289aae85 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:56.444057 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ef707c1-c746-4565-9311-9ee2289aae85 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:56.444507 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ef707c1-c746-4565-9311-9ee2289aae85 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:56.445212 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ef707c1-c746-4565-9311-9ee2289aae85 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:56.445911 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ef707c1-c746-4565-9311-9ee2289aae85 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:56.446383 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7ef707c1-c746-4565-9311-9ee2289aae85 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:56.539563 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-018952d2-2e1d-46f6-bf34-fd2365bae85d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:56.549732 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-018952d2-2e1d-46f6-bf34-fd2365bae85d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:56.551415 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-018952d2-2e1d-46f6-bf34-fd2365bae85d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:56.552892 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-018952d2-2e1d-46f6-bf34-fd2365bae85d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1722 microversion: 2.20 time: 0.312260 Sep 07 16:02:56.553717 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 369/750] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:02:56 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1722 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:02:56.593556 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7ef707c1-c746-4565-9311-9ee2289aae85 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:56.602161 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7ef707c1-c746-4565-9311-9ee2289aae85 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1756 microversion: 2.1 time: 0.169621 Sep 07 16:02:56.602954 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 382/751] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:56 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 16:02:57.342230 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-45c28483-9f34-4b2b-9f98-ea764d871cc5 req-92f8cdcb-f6f3-4e65-80db-ac1495f2a3ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "331c4dfb-7ee1-4585-bed9-2e65fa1f062a", "name": "network-vif-deleted", "tag": "dcda231d-d2f5-41dc-b0c3-658f97c33345"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:02:57.356443 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-45c28483-9f34-4b2b-9f98-ea764d871cc5 req-92f8cdcb-f6f3-4e65-80db-ac1495f2a3ef service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:57.356937 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-45c28483-9f34-4b2b-9f98-ea764d871cc5 req-92f8cdcb-f6f3-4e65-80db-ac1495f2a3ef service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:57.357370 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-45c28483-9f34-4b2b-9f98-ea764d871cc5 req-92f8cdcb-f6f3-4e65-80db-ac1495f2a3ef service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:57.370071 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-45c28483-9f34-4b2b-9f98-ea764d871cc5 req-92f8cdcb-f6f3-4e65-80db-ac1495f2a3ef service nova] Creating event network-vif-deleted:dcda231d-d2f5-41dc-b0c3-658f97c33345 for instance 331c4dfb-7ee1-4585-bed9-2e65fa1f062a on hv-cinder-85331 Sep 07 16:02:57.375891 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-45c28483-9f34-4b2b-9f98-ea764d871cc5 req-92f8cdcb-f6f3-4e65-80db-ac1495f2a3ef service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037533 Sep 07 16:02:57.376763 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 370/752] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:02:57.580146 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b126b890-f901-4df2-bbf4-053fc25d75e2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:57.581365 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b126b890-f901-4df2-bbf4-053fc25d75e2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:57.588396 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b126b890-f901-4df2-bbf4-053fc25d75e2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:57.589206 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b126b890-f901-4df2-bbf4-053fc25d75e2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:57.589649 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b126b890-f901-4df2-bbf4-053fc25d75e2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:57.590353 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b126b890-f901-4df2-bbf4-053fc25d75e2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:57.590811 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b126b890-f901-4df2-bbf4-053fc25d75e2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:57.591238 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b126b890-f901-4df2-bbf4-053fc25d75e2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:57.626170 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d950223c-94e2-4d13-aa4b-a2eb9b0289dd tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:57.626871 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d950223c-94e2-4d13-aa4b-a2eb9b0289dd tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:57.636832 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d950223c-94e2-4d13-aa4b-a2eb9b0289dd tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:57.637331 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d950223c-94e2-4d13-aa4b-a2eb9b0289dd tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:57.637775 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d950223c-94e2-4d13-aa4b-a2eb9b0289dd tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:57.638484 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d950223c-94e2-4d13-aa4b-a2eb9b0289dd tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:57.638944 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d950223c-94e2-4d13-aa4b-a2eb9b0289dd tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:57.639374 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d950223c-94e2-4d13-aa4b-a2eb9b0289dd tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:57.643268 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b126b890-f901-4df2-bbf4-053fc25d75e2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:57.647648 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b126b890-f901-4df2-bbf4-053fc25d75e2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:57.648196 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b126b890-f901-4df2-bbf4-053fc25d75e2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:57.648665 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-b126b890-f901-4df2-bbf4-053fc25d75e2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lazy-loading 'fault' on Instance uuid 331c4dfb-7ee1-4585-bed9-2e65fa1f062a {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 16:02:57.676933 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:02:57.721269 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b126b890-f901-4df2-bbf4-053fc25d75e2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:57.741965 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b126b890-f901-4df2-bbf4-053fc25d75e2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:57.743764 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b126b890-f901-4df2-bbf4-053fc25d75e2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:57.745622 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b126b890-f901-4df2-bbf4-053fc25d75e2 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 200 len: 1370 microversion: 2.20 time: 0.169552 Sep 07 16:02:57.746412 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 383/753] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:02:57 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 1370 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:02:57.839193 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-d950223c-94e2-4d13-aa4b-a2eb9b0289dd tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:57.848139 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d950223c-94e2-4d13-aa4b-a2eb9b0289dd tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1756 microversion: 2.1 time: 0.226054 Sep 07 16:02:57.849189 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 371/754] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:57 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1756 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 16:02:58.774773 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6f373b6d-c2a6-4cbe-aa5b-54b594d34059 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:58.775408 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6f373b6d-c2a6-4cbe-aa5b-54b594d34059 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:58.782415 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f373b6d-c2a6-4cbe-aa5b-54b594d34059 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:58.782894 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f373b6d-c2a6-4cbe-aa5b-54b594d34059 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:58.783329 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f373b6d-c2a6-4cbe-aa5b-54b594d34059 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:58.784040 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f373b6d-c2a6-4cbe-aa5b-54b594d34059 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:58.784498 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f373b6d-c2a6-4cbe-aa5b-54b594d34059 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:58.784909 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6f373b6d-c2a6-4cbe-aa5b-54b594d34059 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:58.798068 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-6f373b6d-c2a6-4cbe-aa5b-54b594d34059 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] HTTP exception thrown: Instance 331c4dfb-7ee1-4585-bed9-2e65fa1f062a could not be found. Sep 07 16:02:58.799747 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6f373b6d-c2a6-4cbe-aa5b-54b594d34059 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Request method failure captured: Sep 07 16:02:58.799747 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a HTTP/1.1 Sep 07 16:02:58.799747 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept: application/json Sep 07 16:02:58.799747 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Sep 07 16:02:58.799747 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Connection: close Sep 07 16:02:58.799747 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Length: 0 Sep 07 16:02:58.799747 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Type: application/json Sep 07 16:02:58.799747 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Host: 10.222.0.17 Sep 07 16:02:58.799747 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Sep 07 16:02:58.799747 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Sep 07 16:02:58.799747 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjGL8UfSLAYh3IEZRraFk1XOdyqIr7UwYKg_9_Iw_xdmBOqlSOBxjkH3sLXfW5kRdmUqwKY4bP20Qmyjbl0r05taSeKvdqP4-7LJUwJq0Ht5mb8sYMqPGKzDtaihaODIpU7WoRN9oKD7BpMcpzD1953xaq2B7kmJRgPUOo7nDaR3C4TmY Sep 07 16:02:58.799747 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Sep 07 16:02:58.799747 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Sep 07 16:02:58.799747 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Sep 07 16:02:58.799747 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Sep 07 16:02:58.799747 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 16:02:58.799747 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Sep 07 16:02:58.799747 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Sep 07 16:02:58.799747 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Id: 64aae5509a124aebbb92ff5dc82e90cf Sep 07 16:02:58.799747 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-744430082 Sep 07 16:02:58.799747 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Role: reader,member Sep 07 16:02:58.799747 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Roles: reader,member Sep 07 16:02:58.801846 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_64aae5509a124aebbb92ff5dc82e90cf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/64aae5509a124aebbb92ff5dc82e90cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/64aae5509a124aebbb92ff5dc82e90cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/64aae5509a124aebbb92ff5dc82e90cf"}]}] Sep 07 16:02:58.801846 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-AttachVolumeShelveTestJSON-744430082 Sep 07 16:02:58.801846 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Id: 64aae5509a124aebbb92ff5dc82e90cf Sep 07 16:02:58.801846 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-744430082 Sep 07 16:02:58.801846 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User: tempest-AttachVolumeShelveTestJSON-744430082-project Sep 07 16:02:58.801846 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Sep 07 16:02:58.801846 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Sep 07 16:02:58.801846 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Id: d7e96593e2814e8b9f7c0f320aa17c3c Sep 07 16:02:58.801846 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-AttachVolumeShelveTestJSON-744430082-project Sep 07 16:02:58.801846 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: method: > Sep 07 16:02:58.801846 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: exception: Instance 331c4dfb-7ee1-4585-bed9-2e65fa1f062a could not be found. Sep 07 16:02:58.801846 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: action_args: {'id': '331c4dfb-7ee1-4585-bed9-2e65fa1f062a'} Sep 07 16:02:58.802806 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 16:02:58.802806 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:02:58.802806 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 16:02:58.802806 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 16:02:58.802806 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 16:02:58.802806 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 16:02:58.802806 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 16:02:58.802806 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 16:02:58.802806 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 16:02:58.802806 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 16:02:58.802806 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 331c4dfb-7ee1-4585-bed9-2e65fa1f062a could not be found. Sep 07 16:02:58.802806 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:02:58.802806 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:02:58.802806 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:02:58.802806 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:02:58.802806 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:02:58.802806 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:02:58.802806 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 16:02:58.802806 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 16:02:58.802806 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 16:02:58.804303 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 16:02:58.804303 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 16:02:58.804303 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 16:02:58.804303 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 16:02:58.804303 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 16:02:58.804303 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 16:02:58.804303 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 16:02:58.804303 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 331c4dfb-7ee1-4585-bed9-2e65fa1f062a could not be found. Sep 07 16:02:58.804303 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:02:58.804303 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:02:58.804303 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:02:58.804303 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:02:58.804303 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:02:58.804303 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:02:58.804303 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 16:02:58.804303 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 16:02:58.804303 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 331c4dfb-7ee1-4585-bed9-2e65fa1f062a could not be found. Sep 07 16:02:58.804303 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:02:58.805780 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6f373b6d-c2a6-4cbe-aa5b-54b594d34059 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Returning 404 to user: Instance 331c4dfb-7ee1-4585-bed9-2e65fa1f062a could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 16:02:58.805780 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6f373b6d-c2a6-4cbe-aa5b-54b594d34059 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 404 len: 111 microversion: 2.20 time: 0.030234 Sep 07 16:02:58.805780 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 384/755] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:02:58 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 16:02:58.810459 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b2200fc5-7e4d-4641-bfb1-59c938558c3f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '.version_select at 0x7ff9a5bd1940>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:58.817407 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:02:58.836579 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b2200fc5-7e4d-4641-bfb1-59c938558c3f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-204181710" status: 204 len: 0 microversion: 2.20 time: 0.030325 Sep 07 16:02:58.837109 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 372/756] 10.222.0.17 () {60 vars in 1259 bytes} [Wed Sep 7 16:02:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-204181710 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 16:02:58.872157 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-10cdbff1-005d-481e-b7b2-6dc573c49fff tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:02:58.873134 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-10cdbff1-005d-481e-b7b2-6dc573c49fff tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:02:58.879655 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10cdbff1-005d-481e-b7b2-6dc573c49fff tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:58.880416 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10cdbff1-005d-481e-b7b2-6dc573c49fff tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:58.881069 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10cdbff1-005d-481e-b7b2-6dc573c49fff tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:58.881822 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10cdbff1-005d-481e-b7b2-6dc573c49fff tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:02:58.882337 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10cdbff1-005d-481e-b7b2-6dc573c49fff tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:02:58.882824 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-10cdbff1-005d-481e-b7b2-6dc573c49fff tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:02:58.901729 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:02:59.050784 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-10cdbff1-005d-481e-b7b2-6dc573c49fff tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:02:59.061117 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-10cdbff1-005d-481e-b7b2-6dc573c49fff tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1756 microversion: 2.1 time: 0.192714 Sep 07 16:02:59.062918 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 385/757] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:02:58 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1756 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:02:59.562911 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e8d80fc4-8f85-4ba1-883d-984b3e9e2e6b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Action: 'create', calling method: .version_select at 0x7ff9a59f8ee0>, body: {"keypair": {"name": "tempest-keypair-1497019674", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPxqCgObJ6HazrDiJpxMiIyocd6Nd59aDU2hjRsuMIxbcFR1rndazWEgttXtzxHWYw7mEWHH0m7cZWv5t9ZNt7DBIKtApidwZ4D/tl2M1HyEfIdrMG/1Q1f8MBlLZZQj8A=="}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:02:59.578979 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.quota [None req-e8d80fc4-8f85-4ba1-883d-984b3e9e2e6b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Getting quotas for project 64aae5509a124aebbb92ff5dc82e90cf. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 16:02:59.582849 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.quota [None req-e8d80fc4-8f85-4ba1-883d-984b3e9e2e6b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Getting quotas for user d7e96593e2814e8b9f7c0f320aa17c3c and project 64aae5509a124aebbb92ff5dc82e90cf. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 16:02:59.603382 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e8d80fc4-8f85-4ba1-883d-984b3e9e2e6b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.044793 Sep 07 16:02:59.603996 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 373/758] 10.222.0.17 () {62 vars in 1200 bytes} [Wed Sep 7 16:02:59 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 46 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 07 16:03:00.086156 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5c89f04c-cd2a-4974-8d0d-ed941f155f91 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:00.086776 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5c89f04c-cd2a-4974-8d0d-ed941f155f91 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:00.093421 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c89f04c-cd2a-4974-8d0d-ed941f155f91 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:00.096101 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c89f04c-cd2a-4974-8d0d-ed941f155f91 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:00.096101 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c89f04c-cd2a-4974-8d0d-ed941f155f91 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:00.096101 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c89f04c-cd2a-4974-8d0d-ed941f155f91 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:00.096101 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c89f04c-cd2a-4974-8d0d-ed941f155f91 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:00.098447 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c89f04c-cd2a-4974-8d0d-ed941f155f91 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:00.243491 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5c89f04c-cd2a-4974-8d0d-ed941f155f91 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:00.253861 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5c89f04c-cd2a-4974-8d0d-ed941f155f91 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1756 microversion: 2.1 time: 0.171485 Sep 07 16:03:00.254440 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 386/759] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:03:00 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:03:01.051338 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d7d0b2a3-1c7d-45c7-a360-4c4bc4e951e9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-560207192", "imageRef": "cfe19284-9779-46f4-b458-81d5475ec82f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f7642c8d-f0b1-421f-82e8-106c8c8a5121"}], "security_groups": [{"name": "tempest-securitygroup--980399714"}], "key_name": "tempest-keypair-1497019674", "user_data": "}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:03:01.159203 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-d7d0b2a3-1c7d-45c7-a360-4c4bc4e951e9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] validate_networks() for [('f7642c8d-f0b1-421f-82e8-106c8c8a5121', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 16:03:01.277743 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c6777040-3bd3-49a6-9bbb-16ccb9691f46 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:01.278333 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c6777040-3bd3-49a6-9bbb-16ccb9691f46 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:01.285420 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6777040-3bd3-49a6-9bbb-16ccb9691f46 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:01.285895 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6777040-3bd3-49a6-9bbb-16ccb9691f46 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:01.286322 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6777040-3bd3-49a6-9bbb-16ccb9691f46 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:01.287004 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6777040-3bd3-49a6-9bbb-16ccb9691f46 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:01.287446 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6777040-3bd3-49a6-9bbb-16ccb9691f46 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:01.287886 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6777040-3bd3-49a6-9bbb-16ccb9691f46 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:01.443137 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c6777040-3bd3-49a6-9bbb-16ccb9691f46 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:01.451268 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c6777040-3bd3-49a6-9bbb-16ccb9691f46 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1756 microversion: 2.1 time: 0.177427 Sep 07 16:03:01.451865 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 387/760] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:03:01 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 16:03:01.635382 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-d7d0b2a3-1c7d-45c7-a360-4c4bc4e951e9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 16:03:01.635839 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-d7d0b2a3-1c7d-45c7-a360-4c4bc4e951e9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 16:03:01.636318 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-d7d0b2a3-1c7d-45c7-a360-4c4bc4e951e9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 16:03:01.636804 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-d7d0b2a3-1c7d-45c7-a360-4c4bc4e951e9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 16:03:01.637189 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-d7d0b2a3-1c7d-45c7-a360-4c4bc4e951e9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 16:03:01.646804 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d7d0b2a3-1c7d-45c7-a360-4c4bc4e951e9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:01.647290 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d7d0b2a3-1c7d-45c7-a360-4c4bc4e951e9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:01.647787 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d7d0b2a3-1c7d-45c7-a360-4c4bc4e951e9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:01.649077 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d7d0b2a3-1c7d-45c7-a360-4c4bc4e951e9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:01.649077 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d7d0b2a3-1c7d-45c7-a360-4c4bc4e951e9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:01.649452 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d7d0b2a3-1c7d-45c7-a360-4c4bc4e951e9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:01.666790 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.quota [None req-d7d0b2a3-1c7d-45c7-a360-4c4bc4e951e9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Getting quotas for project 64aae5509a124aebbb92ff5dc82e90cf. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 16:03:01.671309 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.quota [None req-d7d0b2a3-1c7d-45c7-a360-4c4bc4e951e9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Getting quotas for user d7e96593e2814e8b9f7c0f320aa17c3c and project 64aae5509a124aebbb92ff5dc82e90cf. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 16:03:01.682389 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d7d0b2a3-1c7d-45c7-a360-4c4bc4e951e9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 16:03:01.684727 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d7d0b2a3-1c7d-45c7-a360-4c4bc4e951e9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cfe19284-9779-46f4-b458-81d5475ec82f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 16:03:01.730669 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d7d0b2a3-1c7d-45c7-a360-4c4bc4e951e9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.684654 Sep 07 16:03:01.731315 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 374/761] 10.222.0.17 () {62 vars in 1188 bytes} [Wed Sep 7 16:03:01 2022] POST /compute/v2.1/servers => generated 401 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 07 16:03:01.742874 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-917a3023-17b2-497e-82dd-08e382532590 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:01.743483 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-917a3023-17b2-497e-82dd-08e382532590 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:01.803138 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-917a3023-17b2-497e-82dd-08e382532590 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:01.810670 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-917a3023-17b2-497e-82dd-08e382532590 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:01.812768 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-917a3023-17b2-497e-82dd-08e382532590 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:01.813870 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-917a3023-17b2-497e-82dd-08e382532590 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1281 microversion: 2.20 time: 0.074828 Sep 07 16:03:01.814417 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 388/762] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:03:01 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1281 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:03:02.476453 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9fbef2f5-8e0b-4294-9b62-e514fd292482 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:02.477045 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9fbef2f5-8e0b-4294-9b62-e514fd292482 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:02.483787 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9fbef2f5-8e0b-4294-9b62-e514fd292482 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:02.484360 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9fbef2f5-8e0b-4294-9b62-e514fd292482 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:02.484795 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9fbef2f5-8e0b-4294-9b62-e514fd292482 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:02.485489 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9fbef2f5-8e0b-4294-9b62-e514fd292482 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:02.485937 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9fbef2f5-8e0b-4294-9b62-e514fd292482 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:02.486387 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9fbef2f5-8e0b-4294-9b62-e514fd292482 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:02.636175 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-9fbef2f5-8e0b-4294-9b62-e514fd292482 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:02.645736 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9fbef2f5-8e0b-4294-9b62-e514fd292482 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1756 microversion: 2.1 time: 0.174109 Sep 07 16:03:02.646318 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 375/763] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:03:02 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:03:02.843771 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1a81578a-6592-4940-83db-20550527d84d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:02.844304 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1a81578a-6592-4940-83db-20550527d84d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:02.851855 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a81578a-6592-4940-83db-20550527d84d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:02.852367 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a81578a-6592-4940-83db-20550527d84d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:02.852808 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a81578a-6592-4940-83db-20550527d84d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:02.853513 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a81578a-6592-4940-83db-20550527d84d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:02.853969 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a81578a-6592-4940-83db-20550527d84d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:02.854398 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1a81578a-6592-4940-83db-20550527d84d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:02.918570 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1a81578a-6592-4940-83db-20550527d84d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:02.927679 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1a81578a-6592-4940-83db-20550527d84d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:02.929109 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1a81578a-6592-4940-83db-20550527d84d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:02.930207 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1a81578a-6592-4940-83db-20550527d84d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1333 microversion: 2.20 time: 0.091979 Sep 07 16:03:02.930750 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 389/764] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:03:02 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1333 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:03:03.672955 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-aca19a0c-1bdc-4e24-aaac-5f384d36c033 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:03.673837 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-aca19a0c-1bdc-4e24-aaac-5f384d36c033 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:03.681769 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aca19a0c-1bdc-4e24-aaac-5f384d36c033 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:03.682396 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aca19a0c-1bdc-4e24-aaac-5f384d36c033 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:03.683267 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aca19a0c-1bdc-4e24-aaac-5f384d36c033 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:03.684023 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aca19a0c-1bdc-4e24-aaac-5f384d36c033 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:03.684485 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aca19a0c-1bdc-4e24-aaac-5f384d36c033 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:03.684906 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aca19a0c-1bdc-4e24-aaac-5f384d36c033 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:03.909540 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-aca19a0c-1bdc-4e24-aaac-5f384d36c033 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:03.918850 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-aca19a0c-1bdc-4e24-aaac-5f384d36c033 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1756 microversion: 2.1 time: 0.250536 Sep 07 16:03:03.919696 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 376/765] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:03:03 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1756 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:03:03.955201 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-12b8dde7-b753-4248-a717-9632a8f44b9f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:03.955849 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-12b8dde7-b753-4248-a717-9632a8f44b9f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:03.963404 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12b8dde7-b753-4248-a717-9632a8f44b9f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:03.963933 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12b8dde7-b753-4248-a717-9632a8f44b9f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:03.964375 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12b8dde7-b753-4248-a717-9632a8f44b9f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:03.965124 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12b8dde7-b753-4248-a717-9632a8f44b9f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:03.965512 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12b8dde7-b753-4248-a717-9632a8f44b9f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:03.966081 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-12b8dde7-b753-4248-a717-9632a8f44b9f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:04.118138 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-12b8dde7-b753-4248-a717-9632a8f44b9f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:04.126890 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-12b8dde7-b753-4248-a717-9632a8f44b9f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:04.128442 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-12b8dde7-b753-4248-a717-9632a8f44b9f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:04.129471 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-12b8dde7-b753-4248-a717-9632a8f44b9f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1406 microversion: 2.20 time: 0.178750 Sep 07 16:03:04.130699 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 390/766] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:03:03 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:03:04.870958 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-092871d1-7cb4-4fe3-8f31-821b4f09073e req-7ecc60f8-36bd-4e1d-9639-e4d3107c1717 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08697d07-9370-4fcc-aa5b-d10000a4746f", "tag": "08aa359d-08f5-45a8-976a-77fc0471bfe3"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:03:04.881412 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-092871d1-7cb4-4fe3-8f31-821b4f09073e req-7ecc60f8-36bd-4e1d-9639-e4d3107c1717 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:04.881883 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-092871d1-7cb4-4fe3-8f31-821b4f09073e req-7ecc60f8-36bd-4e1d-9639-e4d3107c1717 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:04.882309 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-092871d1-7cb4-4fe3-8f31-821b4f09073e req-7ecc60f8-36bd-4e1d-9639-e4d3107c1717 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:04.893196 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-092871d1-7cb4-4fe3-8f31-821b4f09073e req-7ecc60f8-36bd-4e1d-9639-e4d3107c1717 service nova] Creating event network-changed:08aa359d-08f5-45a8-976a-77fc0471bfe3 for instance 08697d07-9370-4fcc-aa5b-d10000a4746f on hv-cinder-85331 Sep 07 16:03:04.898528 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-092871d1-7cb4-4fe3-8f31-821b4f09073e req-7ecc60f8-36bd-4e1d-9639-e4d3107c1717 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031152 Sep 07 16:03:04.899377 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 377/767] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 16:03:04.943080 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a3a24643-2a08-48f0-9261-9ec3287e4185 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:04.943641 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a3a24643-2a08-48f0-9261-9ec3287e4185 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:04.949536 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3a24643-2a08-48f0-9261-9ec3287e4185 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:04.950012 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3a24643-2a08-48f0-9261-9ec3287e4185 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:04.950440 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3a24643-2a08-48f0-9261-9ec3287e4185 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:04.951118 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3a24643-2a08-48f0-9261-9ec3287e4185 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:04.951618 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3a24643-2a08-48f0-9261-9ec3287e4185 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:04.952009 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3a24643-2a08-48f0-9261-9ec3287e4185 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:05.105422 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a3a24643-2a08-48f0-9261-9ec3287e4185 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:05.114273 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a3a24643-2a08-48f0-9261-9ec3287e4185 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1756 microversion: 2.1 time: 0.175012 Sep 07 16:03:05.114833 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 391/768] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:03:04 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:03:05.156707 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8ef242c5-d10d-4fa9-9f96-e291932c6186 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:05.157555 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8ef242c5-d10d-4fa9-9f96-e291932c6186 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:05.163969 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8ef242c5-d10d-4fa9-9f96-e291932c6186 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:05.164451 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8ef242c5-d10d-4fa9-9f96-e291932c6186 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:05.164885 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8ef242c5-d10d-4fa9-9f96-e291932c6186 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:05.165576 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8ef242c5-d10d-4fa9-9f96-e291932c6186 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:05.166029 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8ef242c5-d10d-4fa9-9f96-e291932c6186 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:05.166452 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8ef242c5-d10d-4fa9-9f96-e291932c6186 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:05.306472 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-8ef242c5-d10d-4fa9-9f96-e291932c6186 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:05.314689 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-8ef242c5-d10d-4fa9-9f96-e291932c6186 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:05.316133 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-8ef242c5-d10d-4fa9-9f96-e291932c6186 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:05.317411 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8ef242c5-d10d-4fa9-9f96-e291932c6186 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1406 microversion: 2.20 time: 0.166938 Sep 07 16:03:05.318250 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 378/769] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:03:05 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:03:06.138259 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b088099c-e00e-43b6-8650-d9a19d63e1f9 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:06.138865 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b088099c-e00e-43b6-8650-d9a19d63e1f9 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:06.145878 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b088099c-e00e-43b6-8650-d9a19d63e1f9 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:06.146492 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b088099c-e00e-43b6-8650-d9a19d63e1f9 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:06.146930 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b088099c-e00e-43b6-8650-d9a19d63e1f9 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:06.147771 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b088099c-e00e-43b6-8650-d9a19d63e1f9 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:06.148232 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b088099c-e00e-43b6-8650-d9a19d63e1f9 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:06.148654 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b088099c-e00e-43b6-8650-d9a19d63e1f9 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:06.300040 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b088099c-e00e-43b6-8650-d9a19d63e1f9 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:06.311291 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b088099c-e00e-43b6-8650-d9a19d63e1f9 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1756 microversion: 2.1 time: 0.177033 Sep 07 16:03:06.311848 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 392/770] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:03:06 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:03:06.343018 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-57e04a31-8809-49e2-8dcf-6fbdc171a8d4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:06.343774 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-57e04a31-8809-49e2-8dcf-6fbdc171a8d4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:06.350855 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-57e04a31-8809-49e2-8dcf-6fbdc171a8d4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:06.351758 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-57e04a31-8809-49e2-8dcf-6fbdc171a8d4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:06.352427 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-57e04a31-8809-49e2-8dcf-6fbdc171a8d4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:06.353283 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-57e04a31-8809-49e2-8dcf-6fbdc171a8d4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:06.353775 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-57e04a31-8809-49e2-8dcf-6fbdc171a8d4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:06.354301 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-57e04a31-8809-49e2-8dcf-6fbdc171a8d4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:06.487739 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-57e04a31-8809-49e2-8dcf-6fbdc171a8d4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:06.497141 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-57e04a31-8809-49e2-8dcf-6fbdc171a8d4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:06.499369 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-57e04a31-8809-49e2-8dcf-6fbdc171a8d4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:06.501660 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-57e04a31-8809-49e2-8dcf-6fbdc171a8d4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1406 microversion: 2.20 time: 0.162074 Sep 07 16:03:06.501660 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 379/771] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:03:06 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:03:07.335295 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f6ee56e5-3c98-44a9-8676-29f226ba0b06 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:07.335962 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f6ee56e5-3c98-44a9-8676-29f226ba0b06 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:07.343181 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6ee56e5-3c98-44a9-8676-29f226ba0b06 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:07.344001 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6ee56e5-3c98-44a9-8676-29f226ba0b06 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:07.344653 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6ee56e5-3c98-44a9-8676-29f226ba0b06 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:07.345590 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6ee56e5-3c98-44a9-8676-29f226ba0b06 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:07.346243 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6ee56e5-3c98-44a9-8676-29f226ba0b06 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:07.346871 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6ee56e5-3c98-44a9-8676-29f226ba0b06 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:07.465263 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e2df3d23-c331-4f19-873b-1b13215e6d8b tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-39065250", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-415497108", "security_groups": [{"name": "tempest-secgroup-smoke-1506723329"}], "block_device_mapping_v2": [{"uuid": "8ca3ae37-657d-4ad0-8226-61996f79c4ff", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5051af4d-56b8-4439-b299-a2af35922776"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:03:07.511249 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f6ee56e5-3c98-44a9-8676-29f226ba0b06 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:07.520637 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f6ee56e5-3c98-44a9-8676-29f226ba0b06 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1756 microversion: 2.1 time: 0.189070 Sep 07 16:03:07.527937 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 393/772] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:03:07 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1756 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:03:07.537420 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cb64ee87-ef8a-49d7-bd45-cb5f28c563b8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:07.538054 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cb64ee87-ef8a-49d7-bd45-cb5f28c563b8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:07.544403 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb64ee87-ef8a-49d7-bd45-cb5f28c563b8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:07.544891 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb64ee87-ef8a-49d7-bd45-cb5f28c563b8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:07.545330 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb64ee87-ef8a-49d7-bd45-cb5f28c563b8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:07.546084 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb64ee87-ef8a-49d7-bd45-cb5f28c563b8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:07.546533 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb64ee87-ef8a-49d7-bd45-cb5f28c563b8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:07.547222 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb64ee87-ef8a-49d7-bd45-cb5f28c563b8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:07.597446 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-e2df3d23-c331-4f19-873b-1b13215e6d8b tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] validate_networks() for [('5051af4d-56b8-4439-b299-a2af35922776', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 16:03:07.687360 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-cb64ee87-ef8a-49d7-bd45-cb5f28c563b8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:07.696135 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-cb64ee87-ef8a-49d7-bd45-cb5f28c563b8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:07.697590 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-cb64ee87-ef8a-49d7-bd45-cb5f28c563b8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:07.698711 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cb64ee87-ef8a-49d7-bd45-cb5f28c563b8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1406 microversion: 2.20 time: 0.169357 Sep 07 16:03:07.699596 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 394/773] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:03:07 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:03:08.197332 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-e2df3d23-c331-4f19-873b-1b13215e6d8b tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 16:03:08.197769 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-e2df3d23-c331-4f19-873b-1b13215e6d8b tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 16:03:08.198263 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-e2df3d23-c331-4f19-873b-1b13215e6d8b tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 16:03:08.198723 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-e2df3d23-c331-4f19-873b-1b13215e6d8b tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 16:03:08.199220 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-e2df3d23-c331-4f19-873b-1b13215e6d8b tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 16:03:08.209371 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e2df3d23-c331-4f19-873b-1b13215e6d8b tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:08.209869 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e2df3d23-c331-4f19-873b-1b13215e6d8b tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:08.210402 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e2df3d23-c331-4f19-873b-1b13215e6d8b tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:08.211224 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e2df3d23-c331-4f19-873b-1b13215e6d8b tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:08.211756 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e2df3d23-c331-4f19-873b-1b13215e6d8b tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:08.212250 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e2df3d23-c331-4f19-873b-1b13215e6d8b tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:08.229566 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.quota [None req-e2df3d23-c331-4f19-873b-1b13215e6d8b tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Getting quotas for project 6ef2c5a9809b4bee95a171cf6dca4e2b. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 16:03:08.233704 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.quota [None req-e2df3d23-c331-4f19-873b-1b13215e6d8b tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Getting quotas for user d595f32b5f2d406b9d6ce62acec1456b and project 6ef2c5a9809b4bee95a171cf6dca4e2b. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 16:03:08.291078 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e2df3d23-c331-4f19-873b-1b13215e6d8b tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 16:03:08.293222 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e2df3d23-c331-4f19-873b-1b13215e6d8b tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: c936130f-9f16-463d-952f-f9824ab824f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8ca3ae37-657d-4ad0-8226-61996f79c4ff',volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 16:03:08.433437 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e2df3d23-c331-4f19-873b-1b13215e6d8b tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.972463 Sep 07 16:03:08.434055 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 380/774] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Sep 7 16:03:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 974 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 16:03:08.445441 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1208b316-26f0-4c79-af66-a753db83bf23 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:08.446060 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1208b316-26f0-4c79-af66-a753db83bf23 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: c936130f-9f16-463d-952f-f9824ab824f4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:08.503780 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1208b316-26f0-4c79-af66-a753db83bf23 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:08.510864 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1208b316-26f0-4c79-af66-a753db83bf23 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/c936130f-9f16-463d-952f-f9824ab824f4" status: 200 len: 1092 microversion: 2.1 time: 0.069015 Sep 07 16:03:08.511489 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 395/775] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:03:08 2022] GET /compute/v2.1/servers/c936130f-9f16-463d-952f-f9824ab824f4 => generated 1092 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:03:08.546286 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5464882e-0834-4393-9c36-dbe43811142b tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:08.546901 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5464882e-0834-4393-9c36-dbe43811142b tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:08.553240 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5464882e-0834-4393-9c36-dbe43811142b tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:08.553770 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5464882e-0834-4393-9c36-dbe43811142b tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:08.554234 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5464882e-0834-4393-9c36-dbe43811142b tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:08.554922 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5464882e-0834-4393-9c36-dbe43811142b tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:08.555380 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5464882e-0834-4393-9c36-dbe43811142b tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:08.555829 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5464882e-0834-4393-9c36-dbe43811142b tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:08.715217 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-5464882e-0834-4393-9c36-dbe43811142b tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:08.726040 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5464882e-0834-4393-9c36-dbe43811142b tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1756 microversion: 2.1 time: 0.183780 Sep 07 16:03:08.727199 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 381/776] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:03:08 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1756 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:03:08.729961 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2301929e-e858-44eb-b0e8-8d01546b7ad6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:08.732225 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2301929e-e858-44eb-b0e8-8d01546b7ad6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:08.742112 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2301929e-e858-44eb-b0e8-8d01546b7ad6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:08.742729 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2301929e-e858-44eb-b0e8-8d01546b7ad6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:08.743339 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2301929e-e858-44eb-b0e8-8d01546b7ad6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:08.744173 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2301929e-e858-44eb-b0e8-8d01546b7ad6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:08.744754 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2301929e-e858-44eb-b0e8-8d01546b7ad6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:08.745304 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2301929e-e858-44eb-b0e8-8d01546b7ad6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:08.886433 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2301929e-e858-44eb-b0e8-8d01546b7ad6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:08.894407 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2301929e-e858-44eb-b0e8-8d01546b7ad6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:08.895852 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2301929e-e858-44eb-b0e8-8d01546b7ad6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:08.896956 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2301929e-e858-44eb-b0e8-8d01546b7ad6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1406 microversion: 2.20 time: 0.172395 Sep 07 16:03:08.897509 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 396/777] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:03:08 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:03:09.533532 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-85df6fca-1385-492a-bb80-5aae80e3a373 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:09.534143 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-85df6fca-1385-492a-bb80-5aae80e3a373 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: c936130f-9f16-463d-952f-f9824ab824f4] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:09.540525 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-85df6fca-1385-492a-bb80-5aae80e3a373 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:09.541006 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-85df6fca-1385-492a-bb80-5aae80e3a373 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:09.541457 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-85df6fca-1385-492a-bb80-5aae80e3a373 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:09.542121 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-85df6fca-1385-492a-bb80-5aae80e3a373 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:09.542574 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-85df6fca-1385-492a-bb80-5aae80e3a373 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:09.542997 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-85df6fca-1385-492a-bb80-5aae80e3a373 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:09.609614 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-85df6fca-1385-492a-bb80-5aae80e3a373 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:09.617444 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-85df6fca-1385-492a-bb80-5aae80e3a373 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/c936130f-9f16-463d-952f-f9824ab824f4" status: 200 len: 1190 microversion: 2.1 time: 0.088245 Sep 07 16:03:09.618251 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 382/778] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:03:09 2022] GET /compute/v2.1/servers/c936130f-9f16-463d-952f-f9824ab824f4 => generated 1190 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:03:09.750213 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4e23cfd4-318e-4ccd-b154-4cea0b970f86 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:09.750818 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4e23cfd4-318e-4ccd-b154-4cea0b970f86 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:09.757328 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e23cfd4-318e-4ccd-b154-4cea0b970f86 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:09.757805 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e23cfd4-318e-4ccd-b154-4cea0b970f86 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:09.758235 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e23cfd4-318e-4ccd-b154-4cea0b970f86 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:09.758907 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e23cfd4-318e-4ccd-b154-4cea0b970f86 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:09.759357 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e23cfd4-318e-4ccd-b154-4cea0b970f86 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:09.759800 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4e23cfd4-318e-4ccd-b154-4cea0b970f86 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:09.900268 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-4e23cfd4-318e-4ccd-b154-4cea0b970f86 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:09.909205 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4e23cfd4-318e-4ccd-b154-4cea0b970f86 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1756 microversion: 2.1 time: 0.162848 Sep 07 16:03:09.909765 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 397/779] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:03:09 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:03:09.922479 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8236e0d9-523e-43ab-9b23-748134e45c03 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:09.923082 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8236e0d9-523e-43ab-9b23-748134e45c03 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:09.928924 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8236e0d9-523e-43ab-9b23-748134e45c03 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:09.929405 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8236e0d9-523e-43ab-9b23-748134e45c03 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:09.929842 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8236e0d9-523e-43ab-9b23-748134e45c03 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:09.930523 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8236e0d9-523e-43ab-9b23-748134e45c03 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:09.930977 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8236e0d9-523e-43ab-9b23-748134e45c03 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:09.931399 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8236e0d9-523e-43ab-9b23-748134e45c03 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:10.063055 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-8236e0d9-523e-43ab-9b23-748134e45c03 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:10.071389 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-8236e0d9-523e-43ab-9b23-748134e45c03 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:10.072838 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-8236e0d9-523e-43ab-9b23-748134e45c03 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:10.073928 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8236e0d9-523e-43ab-9b23-748134e45c03 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1406 microversion: 2.20 time: 0.155909 Sep 07 16:03:10.074464 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 383/780] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:03:09 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:03:10.640464 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5f14354c-1b35-4171-81bc-ce9c0ec9b316 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:10.641082 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5f14354c-1b35-4171-81bc-ce9c0ec9b316 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: c936130f-9f16-463d-952f-f9824ab824f4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:10.647350 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f14354c-1b35-4171-81bc-ce9c0ec9b316 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:10.647868 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f14354c-1b35-4171-81bc-ce9c0ec9b316 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:10.648305 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f14354c-1b35-4171-81bc-ce9c0ec9b316 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:10.649003 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f14354c-1b35-4171-81bc-ce9c0ec9b316 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:10.649472 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f14354c-1b35-4171-81bc-ce9c0ec9b316 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:10.650124 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5f14354c-1b35-4171-81bc-ce9c0ec9b316 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:10.719352 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5f14354c-1b35-4171-81bc-ce9c0ec9b316 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:10.727937 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5f14354c-1b35-4171-81bc-ce9c0ec9b316 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/c936130f-9f16-463d-952f-f9824ab824f4" status: 200 len: 1208 microversion: 2.1 time: 0.091948 Sep 07 16:03:10.728819 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 398/781] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:03:10 2022] GET /compute/v2.1/servers/c936130f-9f16-463d-952f-f9824ab824f4 => generated 1208 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:03:10.933015 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4928f9cb-57ac-4479-98a8-ddd21251f8f0 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:10.933967 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4928f9cb-57ac-4479-98a8-ddd21251f8f0 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:10.941073 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4928f9cb-57ac-4479-98a8-ddd21251f8f0 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:10.941591 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4928f9cb-57ac-4479-98a8-ddd21251f8f0 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:10.941942 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4928f9cb-57ac-4479-98a8-ddd21251f8f0 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:10.942629 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4928f9cb-57ac-4479-98a8-ddd21251f8f0 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:10.943089 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4928f9cb-57ac-4479-98a8-ddd21251f8f0 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:10.943511 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4928f9cb-57ac-4479-98a8-ddd21251f8f0 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:11.099354 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-99067123-0874-4491-b6ed-6009996960f3 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:11.100008 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-99067123-0874-4491-b6ed-6009996960f3 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:11.106263 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99067123-0874-4491-b6ed-6009996960f3 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:11.106737 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99067123-0874-4491-b6ed-6009996960f3 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:11.107162 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99067123-0874-4491-b6ed-6009996960f3 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:11.107950 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99067123-0874-4491-b6ed-6009996960f3 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:11.108885 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99067123-0874-4491-b6ed-6009996960f3 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:11.109304 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99067123-0874-4491-b6ed-6009996960f3 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:11.189799 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-4928f9cb-57ac-4479-98a8-ddd21251f8f0 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:11.197877 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4928f9cb-57ac-4479-98a8-ddd21251f8f0 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1759 microversion: 2.1 time: 0.268647 Sep 07 16:03:11.198437 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 384/782] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:03:10 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1759 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:03:11.244873 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-99067123-0874-4491-b6ed-6009996960f3 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:11.254009 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-99067123-0874-4491-b6ed-6009996960f3 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:11.255469 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-99067123-0874-4491-b6ed-6009996960f3 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:11.256604 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-99067123-0874-4491-b6ed-6009996960f3 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1406 microversion: 2.20 time: 0.161361 Sep 07 16:03:11.257158 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 399/783] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:03:11 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 16:03:11.751995 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ba729605-e839-4a35-ba24-933a178d277d tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:11.752836 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ba729605-e839-4a35-ba24-933a178d277d tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: c936130f-9f16-463d-952f-f9824ab824f4] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:11.759175 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ba729605-e839-4a35-ba24-933a178d277d tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:11.759877 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ba729605-e839-4a35-ba24-933a178d277d tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:11.760294 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ba729605-e839-4a35-ba24-933a178d277d tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:11.760979 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ba729605-e839-4a35-ba24-933a178d277d tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:11.761778 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ba729605-e839-4a35-ba24-933a178d277d tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:11.762275 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ba729605-e839-4a35-ba24-933a178d277d tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:11.983082 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-ba729605-e839-4a35-ba24-933a178d277d tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:11.990831 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ba729605-e839-4a35-ba24-933a178d277d tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/c936130f-9f16-463d-952f-f9824ab824f4" status: 200 len: 1264 microversion: 2.1 time: 0.243397 Sep 07 16:03:11.991396 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 385/784] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:03:11 2022] GET /compute/v2.1/servers/c936130f-9f16-463d-952f-f9824ab824f4 => generated 1264 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:03:12.123010 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-88febf98-744b-4897-b35a-62e380044dec req-0345cafa-91bb-412b-b6ca-3a8e4a6a2683 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c936130f-9f16-463d-952f-f9824ab824f4", "tag": "b9b821f4-cec8-4dc8-9e63-f93e21c903d5"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:03:12.136999 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-88febf98-744b-4897-b35a-62e380044dec req-0345cafa-91bb-412b-b6ca-3a8e4a6a2683 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:12.137549 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-88febf98-744b-4897-b35a-62e380044dec req-0345cafa-91bb-412b-b6ca-3a8e4a6a2683 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:12.137998 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-88febf98-744b-4897-b35a-62e380044dec req-0345cafa-91bb-412b-b6ca-3a8e4a6a2683 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:12.151014 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-88febf98-744b-4897-b35a-62e380044dec req-0345cafa-91bb-412b-b6ca-3a8e4a6a2683 service nova] Creating event network-changed:b9b821f4-cec8-4dc8-9e63-f93e21c903d5 for instance c936130f-9f16-463d-952f-f9824ab824f4 on hv-cinder-85331 Sep 07 16:03:12.155973 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-88febf98-744b-4897-b35a-62e380044dec req-0345cafa-91bb-412b-b6ca-3a8e4a6a2683 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036597 Sep 07 16:03:12.156804 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 400/785] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:03:12.281327 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-450aee2c-59d2-4046-847c-60fd23fa994f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:12.281929 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-450aee2c-59d2-4046-847c-60fd23fa994f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:12.288015 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-450aee2c-59d2-4046-847c-60fd23fa994f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:12.288483 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-450aee2c-59d2-4046-847c-60fd23fa994f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:12.288912 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-450aee2c-59d2-4046-847c-60fd23fa994f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:12.289582 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-450aee2c-59d2-4046-847c-60fd23fa994f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:12.290023 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-450aee2c-59d2-4046-847c-60fd23fa994f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:12.290438 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-450aee2c-59d2-4046-847c-60fd23fa994f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:12.491105 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-450aee2c-59d2-4046-847c-60fd23fa994f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:12.499275 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-450aee2c-59d2-4046-847c-60fd23fa994f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:12.500739 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-450aee2c-59d2-4046-847c-60fd23fa994f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:12.501841 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-450aee2c-59d2-4046-847c-60fd23fa994f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1406 microversion: 2.20 time: 0.224900 Sep 07 16:03:12.502394 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 386/786] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:03:12 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1406 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:03:12.859558 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-261bd807-bc8c-489e-8d0b-993a27ff678a req-46815bbf-91cf-4c88-8a5b-94a2378a07a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08697d07-9370-4fcc-aa5b-d10000a4746f", "name": "network-vif-plugged", "status": "completed", "tag": "08aa359d-08f5-45a8-976a-77fc0471bfe3"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:03:12.870639 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-261bd807-bc8c-489e-8d0b-993a27ff678a req-46815bbf-91cf-4c88-8a5b-94a2378a07a1 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:12.871115 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-261bd807-bc8c-489e-8d0b-993a27ff678a req-46815bbf-91cf-4c88-8a5b-94a2378a07a1 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:12.871566 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-261bd807-bc8c-489e-8d0b-993a27ff678a req-46815bbf-91cf-4c88-8a5b-94a2378a07a1 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:12.882401 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-261bd807-bc8c-489e-8d0b-993a27ff678a req-46815bbf-91cf-4c88-8a5b-94a2378a07a1 service nova] Creating event network-vif-plugged:08aa359d-08f5-45a8-976a-77fc0471bfe3 for instance 08697d07-9370-4fcc-aa5b-d10000a4746f on hv-cinder-85331 Sep 07 16:03:12.887600 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-261bd807-bc8c-489e-8d0b-993a27ff678a req-46815bbf-91cf-4c88-8a5b-94a2378a07a1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092057 Sep 07 16:03:12.888174 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 401/787] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:03:13.014666 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-833b9dad-a110-47c3-ba9f-a61a202f0a24 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:13.015211 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-833b9dad-a110-47c3-ba9f-a61a202f0a24 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: c936130f-9f16-463d-952f-f9824ab824f4] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:13.022308 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-833b9dad-a110-47c3-ba9f-a61a202f0a24 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:13.022803 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-833b9dad-a110-47c3-ba9f-a61a202f0a24 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:13.023241 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-833b9dad-a110-47c3-ba9f-a61a202f0a24 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:13.023962 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-833b9dad-a110-47c3-ba9f-a61a202f0a24 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:13.024419 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-833b9dad-a110-47c3-ba9f-a61a202f0a24 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:13.024844 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-833b9dad-a110-47c3-ba9f-a61a202f0a24 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:13.155967 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-833b9dad-a110-47c3-ba9f-a61a202f0a24 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:13.163751 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-833b9dad-a110-47c3-ba9f-a61a202f0a24 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/c936130f-9f16-463d-952f-f9824ab824f4" status: 200 len: 1264 microversion: 2.1 time: 0.153762 Sep 07 16:03:13.164313 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 387/788] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:03:13 2022] GET /compute/v2.1/servers/c936130f-9f16-463d-952f-f9824ab824f4 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:03:13.526840 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-381ba5f5-4139-41e7-8a15-797bf08ebe3d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:13.527528 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-381ba5f5-4139-41e7-8a15-797bf08ebe3d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:13.534053 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-381ba5f5-4139-41e7-8a15-797bf08ebe3d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:13.534539 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-381ba5f5-4139-41e7-8a15-797bf08ebe3d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:13.534948 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-381ba5f5-4139-41e7-8a15-797bf08ebe3d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:13.535646 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-381ba5f5-4139-41e7-8a15-797bf08ebe3d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:13.536091 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-381ba5f5-4139-41e7-8a15-797bf08ebe3d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:13.536506 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-381ba5f5-4139-41e7-8a15-797bf08ebe3d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:13.668130 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-381ba5f5-4139-41e7-8a15-797bf08ebe3d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:13.676666 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-381ba5f5-4139-41e7-8a15-797bf08ebe3d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:13.678094 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-381ba5f5-4139-41e7-8a15-797bf08ebe3d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:13.679192 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-381ba5f5-4139-41e7-8a15-797bf08ebe3d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1406 microversion: 2.20 time: 0.156649 Sep 07 16:03:13.679782 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 402/789] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:03:13 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:03:14.188937 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f31fd693-bac0-4e3a-ac8e-ccb92ed1ab6a tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:14.189765 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f31fd693-bac0-4e3a-ac8e-ccb92ed1ab6a tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: c936130f-9f16-463d-952f-f9824ab824f4] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:14.196813 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f31fd693-bac0-4e3a-ac8e-ccb92ed1ab6a tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:14.197482 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f31fd693-bac0-4e3a-ac8e-ccb92ed1ab6a tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:14.197904 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f31fd693-bac0-4e3a-ac8e-ccb92ed1ab6a tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:14.198778 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f31fd693-bac0-4e3a-ac8e-ccb92ed1ab6a tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:14.199230 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f31fd693-bac0-4e3a-ac8e-ccb92ed1ab6a tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:14.199718 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f31fd693-bac0-4e3a-ac8e-ccb92ed1ab6a tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:14.558891 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-f31fd693-bac0-4e3a-ac8e-ccb92ed1ab6a tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:14.567233 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f31fd693-bac0-4e3a-ac8e-ccb92ed1ab6a tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/c936130f-9f16-463d-952f-f9824ab824f4" status: 200 len: 1264 microversion: 2.1 time: 0.384938 Sep 07 16:03:14.567829 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 388/790] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:03:14 2022] GET /compute/v2.1/servers/c936130f-9f16-463d-952f-f9824ab824f4 => generated 1264 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:03:14.704379 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f6991dfa-b287-4231-847c-0389618bf224 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:14.704944 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f6991dfa-b287-4231-847c-0389618bf224 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:14.711288 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6991dfa-b287-4231-847c-0389618bf224 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:14.711794 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6991dfa-b287-4231-847c-0389618bf224 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:14.712226 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6991dfa-b287-4231-847c-0389618bf224 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:14.712900 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6991dfa-b287-4231-847c-0389618bf224 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:14.713343 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6991dfa-b287-4231-847c-0389618bf224 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:14.713756 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f6991dfa-b287-4231-847c-0389618bf224 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:14.845461 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f6991dfa-b287-4231-847c-0389618bf224 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:14.853665 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f6991dfa-b287-4231-847c-0389618bf224 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:14.855082 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f6991dfa-b287-4231-847c-0389618bf224 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:14.856216 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f6991dfa-b287-4231-847c-0389618bf224 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1406 microversion: 2.20 time: 0.155849 Sep 07 16:03:14.856772 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 403/791] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:03:14 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:03:15.589680 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-75ef7d69-9cc0-445d-aa5c-939ee5742abf tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:15.590315 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-75ef7d69-9cc0-445d-aa5c-939ee5742abf tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: c936130f-9f16-463d-952f-f9824ab824f4] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:15.597241 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-75ef7d69-9cc0-445d-aa5c-939ee5742abf tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:15.597724 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-75ef7d69-9cc0-445d-aa5c-939ee5742abf tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:15.598155 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-75ef7d69-9cc0-445d-aa5c-939ee5742abf tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:15.599092 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-75ef7d69-9cc0-445d-aa5c-939ee5742abf tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:15.599572 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-75ef7d69-9cc0-445d-aa5c-939ee5742abf tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:15.599992 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-75ef7d69-9cc0-445d-aa5c-939ee5742abf tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:15.732165 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-75ef7d69-9cc0-445d-aa5c-939ee5742abf tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:15.740276 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-75ef7d69-9cc0-445d-aa5c-939ee5742abf tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/c936130f-9f16-463d-952f-f9824ab824f4" status: 200 len: 1264 microversion: 2.1 time: 0.154417 Sep 07 16:03:15.740828 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 389/792] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:03:15 2022] GET /compute/v2.1/servers/c936130f-9f16-463d-952f-f9824ab824f4 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:03:15.881871 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7482b214-c382-4c43-8546-aa219dc3eba6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:15.882415 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7482b214-c382-4c43-8546-aa219dc3eba6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:15.888716 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7482b214-c382-4c43-8546-aa219dc3eba6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:15.889190 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7482b214-c382-4c43-8546-aa219dc3eba6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:15.889616 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7482b214-c382-4c43-8546-aa219dc3eba6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:15.890291 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7482b214-c382-4c43-8546-aa219dc3eba6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:15.890741 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7482b214-c382-4c43-8546-aa219dc3eba6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:15.891157 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7482b214-c382-4c43-8546-aa219dc3eba6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:16.016035 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7482b214-c382-4c43-8546-aa219dc3eba6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:16.023834 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7482b214-c382-4c43-8546-aa219dc3eba6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:16.025236 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7482b214-c382-4c43-8546-aa219dc3eba6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:16.026366 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7482b214-c382-4c43-8546-aa219dc3eba6 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1598 microversion: 2.20 time: 0.148744 Sep 07 16:03:16.026911 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 404/793] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:03:15 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1598 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:03:16.050877 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-23b34eb3-3698-41db-bb85-742af9fd9e51 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:16.051383 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-23b34eb3-3698-41db-bb85-742af9fd9e51 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:16.057203 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-23b34eb3-3698-41db-bb85-742af9fd9e51 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:16.057684 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-23b34eb3-3698-41db-bb85-742af9fd9e51 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:16.058116 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-23b34eb3-3698-41db-bb85-742af9fd9e51 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:16.058802 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-23b34eb3-3698-41db-bb85-742af9fd9e51 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:16.059256 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-23b34eb3-3698-41db-bb85-742af9fd9e51 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:16.059771 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-23b34eb3-3698-41db-bb85-742af9fd9e51 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:16.138397 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-23b34eb3-3698-41db-bb85-742af9fd9e51 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.091290 Sep 07 16:03:16.139475 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 390/794] 10.222.0.17 () {60 vars in 1316 bytes} [Wed Sep 7 16:03:16 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 16:03:16.762153 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-11fb8afd-9438-4c44-b8d9-b3035e27d186 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:16.762675 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-11fb8afd-9438-4c44-b8d9-b3035e27d186 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: c936130f-9f16-463d-952f-f9824ab824f4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:16.768788 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-11fb8afd-9438-4c44-b8d9-b3035e27d186 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:16.769261 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-11fb8afd-9438-4c44-b8d9-b3035e27d186 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:16.769689 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-11fb8afd-9438-4c44-b8d9-b3035e27d186 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:16.770371 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-11fb8afd-9438-4c44-b8d9-b3035e27d186 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:16.770815 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-11fb8afd-9438-4c44-b8d9-b3035e27d186 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:16.771237 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-11fb8afd-9438-4c44-b8d9-b3035e27d186 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:16.788833 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:16.901812 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-11fb8afd-9438-4c44-b8d9-b3035e27d186 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:16.909864 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-11fb8afd-9438-4c44-b8d9-b3035e27d186 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/c936130f-9f16-463d-952f-f9824ab824f4" status: 200 len: 1264 microversion: 2.1 time: 0.151421 Sep 07 16:03:16.910438 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 405/795] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:03:16 2022] GET /compute/v2.1/servers/c936130f-9f16-463d-952f-f9824ab824f4 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:03:17.284933 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-5d652310-124b-4b33-a467-404506c2e4d2 req-c4717b4d-0c05-4a52-88a7-61be8666bc6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08697d07-9370-4fcc-aa5b-d10000a4746f", "tag": "08aa359d-08f5-45a8-976a-77fc0471bfe3"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:03:17.294287 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-5d652310-124b-4b33-a467-404506c2e4d2 req-c4717b4d-0c05-4a52-88a7-61be8666bc6c service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:17.294765 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-5d652310-124b-4b33-a467-404506c2e4d2 req-c4717b4d-0c05-4a52-88a7-61be8666bc6c service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:17.295762 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-5d652310-124b-4b33-a467-404506c2e4d2 req-c4717b4d-0c05-4a52-88a7-61be8666bc6c service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:17.306654 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-5d652310-124b-4b33-a467-404506c2e4d2 req-c4717b4d-0c05-4a52-88a7-61be8666bc6c service nova] Creating event network-changed:08aa359d-08f5-45a8-976a-77fc0471bfe3 for instance 08697d07-9370-4fcc-aa5b-d10000a4746f on hv-cinder-85331 Sep 07 16:03:17.312213 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-5d652310-124b-4b33-a467-404506c2e4d2 req-c4717b4d-0c05-4a52-88a7-61be8666bc6c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031214 Sep 07 16:03:17.312920 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 391/796] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:03:17.933294 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9a22c414-2c14-4f54-ab16-4195c3cb2101 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:17.933847 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9a22c414-2c14-4f54-ab16-4195c3cb2101 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: c936130f-9f16-463d-952f-f9824ab824f4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:17.940688 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a22c414-2c14-4f54-ab16-4195c3cb2101 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:17.941166 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a22c414-2c14-4f54-ab16-4195c3cb2101 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:17.941597 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a22c414-2c14-4f54-ab16-4195c3cb2101 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:17.942278 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a22c414-2c14-4f54-ab16-4195c3cb2101 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:17.942752 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a22c414-2c14-4f54-ab16-4195c3cb2101 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:17.943174 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9a22c414-2c14-4f54-ab16-4195c3cb2101 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:18.076286 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9a22c414-2c14-4f54-ab16-4195c3cb2101 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:18.084190 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9a22c414-2c14-4f54-ab16-4195c3cb2101 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/c936130f-9f16-463d-952f-f9824ab824f4" status: 200 len: 1264 microversion: 2.1 time: 0.154932 Sep 07 16:03:18.084755 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 406/797] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:03:17 2022] GET /compute/v2.1/servers/c936130f-9f16-463d-952f-f9824ab824f4 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:03:19.104735 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=4 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:19.105542 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=16 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:19.111072 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8107fc4a-c302-484b-b701-cda102646ac5 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:19.111882 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8107fc4a-c302-484b-b701-cda102646ac5 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: c936130f-9f16-463d-952f-f9824ab824f4] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:19.118792 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8107fc4a-c302-484b-b701-cda102646ac5 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:19.119269 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8107fc4a-c302-484b-b701-cda102646ac5 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:19.119731 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8107fc4a-c302-484b-b701-cda102646ac5 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:19.120412 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8107fc4a-c302-484b-b701-cda102646ac5 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:19.120861 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8107fc4a-c302-484b-b701-cda102646ac5 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:19.121284 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8107fc4a-c302-484b-b701-cda102646ac5 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:19.250911 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-8107fc4a-c302-484b-b701-cda102646ac5 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:19.258663 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8107fc4a-c302-484b-b701-cda102646ac5 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/c936130f-9f16-463d-952f-f9824ab824f4" status: 200 len: 1264 microversion: 2.1 time: 0.154931 Sep 07 16:03:19.259226 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 392/798] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:03:19 2022] GET /compute/v2.1/servers/c936130f-9f16-463d-952f-f9824ab824f4 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:03:20.281022 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-569fe688-d961-4d20-ad24-2b170ededc43 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:20.281623 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-569fe688-d961-4d20-ad24-2b170ededc43 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: c936130f-9f16-463d-952f-f9824ab824f4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:20.283432 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=4 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:20.289115 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-569fe688-d961-4d20-ad24-2b170ededc43 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:20.289588 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-569fe688-d961-4d20-ad24-2b170ededc43 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:20.290056 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-569fe688-d961-4d20-ad24-2b170ededc43 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:20.290729 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-569fe688-d961-4d20-ad24-2b170ededc43 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:20.291172 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-569fe688-d961-4d20-ad24-2b170ededc43 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:20.291613 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-569fe688-d961-4d20-ad24-2b170ededc43 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:20.417417 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-569fe688-d961-4d20-ad24-2b170ededc43 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:20.425389 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-569fe688-d961-4d20-ad24-2b170ededc43 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/c936130f-9f16-463d-952f-f9824ab824f4" status: 200 len: 1264 microversion: 2.1 time: 0.148183 Sep 07 16:03:20.425940 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 407/799] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:03:20 2022] GET /compute/v2.1/servers/c936130f-9f16-463d-952f-f9824ab824f4 => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:03:21.448092 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f983810b-f353-421d-a18a-ca41536bf5c7 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:21.448727 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f983810b-f353-421d-a18a-ca41536bf5c7 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: c936130f-9f16-463d-952f-f9824ab824f4] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:21.455269 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f983810b-f353-421d-a18a-ca41536bf5c7 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:21.455793 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f983810b-f353-421d-a18a-ca41536bf5c7 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:21.456234 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f983810b-f353-421d-a18a-ca41536bf5c7 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:21.456927 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f983810b-f353-421d-a18a-ca41536bf5c7 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:21.457383 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f983810b-f353-421d-a18a-ca41536bf5c7 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:21.457811 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f983810b-f353-421d-a18a-ca41536bf5c7 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:21.461824 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=100 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:21.590185 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-f983810b-f353-421d-a18a-ca41536bf5c7 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:21.598332 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f983810b-f353-421d-a18a-ca41536bf5c7 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/c936130f-9f16-463d-952f-f9824ab824f4" status: 200 len: 1264 microversion: 2.1 time: 0.154116 Sep 07 16:03:21.599135 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 393/800] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:03:21 2022] GET /compute/v2.1/servers/c936130f-9f16-463d-952f-f9824ab824f4 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:03:22.622473 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f26dcec2-c08a-44f6-875a-5bf181e19461 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:22.623773 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f26dcec2-c08a-44f6-875a-5bf181e19461 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: c936130f-9f16-463d-952f-f9824ab824f4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:22.630305 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f26dcec2-c08a-44f6-875a-5bf181e19461 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:22.630785 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f26dcec2-c08a-44f6-875a-5bf181e19461 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:22.631232 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f26dcec2-c08a-44f6-875a-5bf181e19461 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:22.631929 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f26dcec2-c08a-44f6-875a-5bf181e19461 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:22.632379 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f26dcec2-c08a-44f6-875a-5bf181e19461 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:22.632801 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f26dcec2-c08a-44f6-875a-5bf181e19461 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:22.768442 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f26dcec2-c08a-44f6-875a-5bf181e19461 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:22.776037 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f26dcec2-c08a-44f6-875a-5bf181e19461 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/c936130f-9f16-463d-952f-f9824ab824f4" status: 200 len: 1264 microversion: 2.1 time: 0.158181 Sep 07 16:03:22.776592 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 408/801] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:03:22 2022] GET /compute/v2.1/servers/c936130f-9f16-463d-952f-f9824ab824f4 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:03:22.847748 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-7a2e71e7-d2f4-4983-b1c4-496e9e0cfec2 req-7bbd6195-2537-4848-bbf5-183372926294 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c936130f-9f16-463d-952f-f9824ab824f4", "name": "network-vif-plugged", "status": "completed", "tag": "b9b821f4-cec8-4dc8-9e63-f93e21c903d5"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:03:22.860118 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-7a2e71e7-d2f4-4983-b1c4-496e9e0cfec2 req-7bbd6195-2537-4848-bbf5-183372926294 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:22.860686 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-7a2e71e7-d2f4-4983-b1c4-496e9e0cfec2 req-7bbd6195-2537-4848-bbf5-183372926294 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:22.861192 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-7a2e71e7-d2f4-4983-b1c4-496e9e0cfec2 req-7bbd6195-2537-4848-bbf5-183372926294 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:22.872440 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-7a2e71e7-d2f4-4983-b1c4-496e9e0cfec2 req-7bbd6195-2537-4848-bbf5-183372926294 service nova] Creating event network-vif-plugged:b9b821f4-cec8-4dc8-9e63-f93e21c903d5 for instance c936130f-9f16-463d-952f-f9824ab824f4 on hv-cinder-85331 Sep 07 16:03:22.878311 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-7a2e71e7-d2f4-4983-b1c4-496e9e0cfec2 req-7bbd6195-2537-4848-bbf5-183372926294 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034043 Sep 07 16:03:22.879244 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 394/802] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:03:23.799231 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bcb671c2-d9ce-4029-ae5e-2fc6cda85792 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:23.799863 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bcb671c2-d9ce-4029-ae5e-2fc6cda85792 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: c936130f-9f16-463d-952f-f9824ab824f4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:23.806671 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bcb671c2-d9ce-4029-ae5e-2fc6cda85792 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:23.807257 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bcb671c2-d9ce-4029-ae5e-2fc6cda85792 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:23.807782 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bcb671c2-d9ce-4029-ae5e-2fc6cda85792 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:23.808578 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bcb671c2-d9ce-4029-ae5e-2fc6cda85792 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:23.809027 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bcb671c2-d9ce-4029-ae5e-2fc6cda85792 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:23.809443 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bcb671c2-d9ce-4029-ae5e-2fc6cda85792 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:23.938943 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-bcb671c2-d9ce-4029-ae5e-2fc6cda85792 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:23.946413 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bcb671c2-d9ce-4029-ae5e-2fc6cda85792 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/c936130f-9f16-463d-952f-f9824ab824f4" status: 200 len: 1264 microversion: 2.1 time: 0.151421 Sep 07 16:03:23.946958 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 409/803] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:03:23 2022] GET /compute/v2.1/servers/c936130f-9f16-463d-952f-f9824ab824f4 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:03:24.970073 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e20ec1ad-24be-418e-bb09-88d8524b2973 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:24.970778 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e20ec1ad-24be-418e-bb09-88d8524b2973 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: c936130f-9f16-463d-952f-f9824ab824f4] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:24.977136 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e20ec1ad-24be-418e-bb09-88d8524b2973 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:24.977618 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e20ec1ad-24be-418e-bb09-88d8524b2973 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:24.978048 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e20ec1ad-24be-418e-bb09-88d8524b2973 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:24.978723 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e20ec1ad-24be-418e-bb09-88d8524b2973 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:24.979173 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e20ec1ad-24be-418e-bb09-88d8524b2973 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:24.979646 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e20ec1ad-24be-418e-bb09-88d8524b2973 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:25.111985 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-e20ec1ad-24be-418e-bb09-88d8524b2973 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:25.119752 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e20ec1ad-24be-418e-bb09-88d8524b2973 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/c936130f-9f16-463d-952f-f9824ab824f4" status: 200 len: 1450 microversion: 2.1 time: 0.154441 Sep 07 16:03:25.120314 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 395/804] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:03:24 2022] GET /compute/v2.1/servers/c936130f-9f16-463d-952f-f9824ab824f4 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:03:25.142166 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b6b6867e-494d-4ccb-9a0e-48607d8849d9 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:25.142789 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b6b6867e-494d-4ccb-9a0e-48607d8849d9 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: c936130f-9f16-463d-952f-f9824ab824f4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:25.149067 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6b6867e-494d-4ccb-9a0e-48607d8849d9 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:25.149538 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6b6867e-494d-4ccb-9a0e-48607d8849d9 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:25.149968 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6b6867e-494d-4ccb-9a0e-48607d8849d9 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:25.150635 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6b6867e-494d-4ccb-9a0e-48607d8849d9 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:25.151075 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6b6867e-494d-4ccb-9a0e-48607d8849d9 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:25.151534 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6b6867e-494d-4ccb-9a0e-48607d8849d9 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:25.276806 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b6b6867e-494d-4ccb-9a0e-48607d8849d9 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:25.284833 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b6b6867e-494d-4ccb-9a0e-48607d8849d9 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/c936130f-9f16-463d-952f-f9824ab824f4" status: 200 len: 1450 microversion: 2.1 time: 0.146509 Sep 07 16:03:25.285385 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 410/805] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:03:25 2022] GET /compute/v2.1/servers/c936130f-9f16-463d-952f-f9824ab824f4 => generated 1450 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:03:26.863596 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-393a5297-3868-4a7c-a14c-bcb9cd016922 req-e0b090ad-445f-43ba-8ed7-26340958e083 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c936130f-9f16-463d-952f-f9824ab824f4", "tag": "b9b821f4-cec8-4dc8-9e63-f93e21c903d5"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:03:26.873227 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-393a5297-3868-4a7c-a14c-bcb9cd016922 req-e0b090ad-445f-43ba-8ed7-26340958e083 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:26.873696 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-393a5297-3868-4a7c-a14c-bcb9cd016922 req-e0b090ad-445f-43ba-8ed7-26340958e083 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:26.874117 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-393a5297-3868-4a7c-a14c-bcb9cd016922 req-e0b090ad-445f-43ba-8ed7-26340958e083 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:26.885029 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-393a5297-3868-4a7c-a14c-bcb9cd016922 req-e0b090ad-445f-43ba-8ed7-26340958e083 service nova] Creating event network-changed:b9b821f4-cec8-4dc8-9e63-f93e21c903d5 for instance c936130f-9f16-463d-952f-f9824ab824f4 on hv-cinder-85331 Sep 07 16:03:26.889819 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-393a5297-3868-4a7c-a14c-bcb9cd016922 req-e0b090ad-445f-43ba-8ed7-26340958e083 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029904 Sep 07 16:03:26.890399 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 396/806] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:03:41.864037 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=65 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:41.864787 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=32 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:41.959865 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4f859e68-2f0f-4f3d-8b9a-587f73ebcbaa tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:41.960355 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4f859e68-2f0f-4f3d-8b9a-587f73ebcbaa tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:41.966646 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f859e68-2f0f-4f3d-8b9a-587f73ebcbaa tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:41.967125 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f859e68-2f0f-4f3d-8b9a-587f73ebcbaa tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:41.967574 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f859e68-2f0f-4f3d-8b9a-587f73ebcbaa tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:41.968261 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f859e68-2f0f-4f3d-8b9a-587f73ebcbaa tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:41.968712 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f859e68-2f0f-4f3d-8b9a-587f73ebcbaa tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:41.969135 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4f859e68-2f0f-4f3d-8b9a-587f73ebcbaa tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:42.053202 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-4f859e68-2f0f-4f3d-8b9a-587f73ebcbaa tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lazy-loading 'services' on Instance uuid d9f7188c-7dad-469c-b915-511d7f6f7a14 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 16:03:42.125524 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4f859e68-2f0f-4f3d-8b9a-587f73ebcbaa tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14/os-volume_attachments/99bc7dae-f25a-4c52-83ef-cdc45f57376d" status: 202 len: 0 microversion: 2.1 time: 0.266342 Sep 07 16:03:42.126037 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 411/807] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Sep 7 16:03:41 2022] DELETE /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14/os-volume_attachments/99bc7dae-f25a-4c52-83ef-cdc45f57376d => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 16:03:44.302850 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=1,nova_api:INSERT=7 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:44.303737 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=14 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:44.307643 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-64f60102-6b98-4316-99fa-40a573d91952 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:03:44.315216 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-64f60102-6b98-4316-99fa-40a573d91952 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:44.315728 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-64f60102-6b98-4316-99fa-40a573d91952 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:44.316166 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-64f60102-6b98-4316-99fa-40a573d91952 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:44.338700 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-64f60102-6b98-4316-99fa-40a573d91952 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Going to try to stop instance {{(pid=120641) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 07 16:03:44.379611 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-64f60102-6b98-4316-99fa-40a573d91952 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "POST /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14/action" status: 202 len: 0 microversion: 2.1 time: 0.078058 Sep 07 16:03:44.380183 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 397/808] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Sep 7 16:03:44 2022] POST /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 16:03:44.389714 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bfdcb758-309e-4459-95fc-8ec93a0d2ed4 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:44.390411 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bfdcb758-309e-4459-95fc-8ec93a0d2ed4 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:44.397655 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bfdcb758-309e-4459-95fc-8ec93a0d2ed4 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:44.398201 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bfdcb758-309e-4459-95fc-8ec93a0d2ed4 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:44.399534 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bfdcb758-309e-4459-95fc-8ec93a0d2ed4 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:44.400260 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bfdcb758-309e-4459-95fc-8ec93a0d2ed4 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:44.400710 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bfdcb758-309e-4459-95fc-8ec93a0d2ed4 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:44.401522 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bfdcb758-309e-4459-95fc-8ec93a0d2ed4 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:44.535596 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-bfdcb758-309e-4459-95fc-8ec93a0d2ed4 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:44.543317 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bfdcb758-309e-4459-95fc-8ec93a0d2ed4 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1680 microversion: 2.1 time: 0.158019 Sep 07 16:03:44.543897 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 412/809] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:03:44 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 16:03:45.566786 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8e34135f-3442-466c-98c5-51edcac1b9da tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:45.567409 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8e34135f-3442-466c-98c5-51edcac1b9da tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:45.573896 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8e34135f-3442-466c-98c5-51edcac1b9da tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:45.574374 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8e34135f-3442-466c-98c5-51edcac1b9da tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:45.574813 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8e34135f-3442-466c-98c5-51edcac1b9da tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:45.575519 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8e34135f-3442-466c-98c5-51edcac1b9da tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:45.575992 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8e34135f-3442-466c-98c5-51edcac1b9da tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:45.576408 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8e34135f-3442-466c-98c5-51edcac1b9da tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:45.708796 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-8e34135f-3442-466c-98c5-51edcac1b9da tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:45.716917 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8e34135f-3442-466c-98c5-51edcac1b9da tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1680 microversion: 2.1 time: 0.154558 Sep 07 16:03:45.717479 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 398/810] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:03:45 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:03:46.739895 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a4b0175d-d194-4651-8e9a-8a69e88676f5 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:46.740426 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a4b0175d-d194-4651-8e9a-8a69e88676f5 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:46.746751 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a4b0175d-d194-4651-8e9a-8a69e88676f5 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:46.747230 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a4b0175d-d194-4651-8e9a-8a69e88676f5 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:46.747709 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a4b0175d-d194-4651-8e9a-8a69e88676f5 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:46.748399 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a4b0175d-d194-4651-8e9a-8a69e88676f5 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:46.748856 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a4b0175d-d194-4651-8e9a-8a69e88676f5 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:46.749281 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a4b0175d-d194-4651-8e9a-8a69e88676f5 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:46.873191 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a4b0175d-d194-4651-8e9a-8a69e88676f5 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:46.880722 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a4b0175d-d194-4651-8e9a-8a69e88676f5 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1680 microversion: 2.1 time: 0.144816 Sep 07 16:03:46.881281 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 413/811] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:03:46 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1680 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:03:47.904540 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7c20de72-a7e1-49e7-a000-a9dda9da7f6b tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:47.905147 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7c20de72-a7e1-49e7-a000-a9dda9da7f6b tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:47.911532 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c20de72-a7e1-49e7-a000-a9dda9da7f6b tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:47.912049 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c20de72-a7e1-49e7-a000-a9dda9da7f6b tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:47.912478 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c20de72-a7e1-49e7-a000-a9dda9da7f6b tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:47.913159 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c20de72-a7e1-49e7-a000-a9dda9da7f6b tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:47.913613 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c20de72-a7e1-49e7-a000-a9dda9da7f6b tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:47.914035 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c20de72-a7e1-49e7-a000-a9dda9da7f6b tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:48.038731 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-7c20de72-a7e1-49e7-a000-a9dda9da7f6b tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:48.047000 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7c20de72-a7e1-49e7-a000-a9dda9da7f6b tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1680 microversion: 2.1 time: 0.146805 Sep 07 16:03:48.047562 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 399/812] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:03:47 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1680 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:03:49.069808 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-38e2b94f-9b6a-4ea9-81b9-e0f14ab24e14 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:49.070424 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-38e2b94f-9b6a-4ea9-81b9-e0f14ab24e14 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:49.076773 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38e2b94f-9b6a-4ea9-81b9-e0f14ab24e14 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:49.077252 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38e2b94f-9b6a-4ea9-81b9-e0f14ab24e14 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:49.077708 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38e2b94f-9b6a-4ea9-81b9-e0f14ab24e14 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:49.078393 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38e2b94f-9b6a-4ea9-81b9-e0f14ab24e14 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:49.078843 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38e2b94f-9b6a-4ea9-81b9-e0f14ab24e14 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:49.079268 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38e2b94f-9b6a-4ea9-81b9-e0f14ab24e14 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:49.206426 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-38e2b94f-9b6a-4ea9-81b9-e0f14ab24e14 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:49.214006 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-38e2b94f-9b6a-4ea9-81b9-e0f14ab24e14 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1680 microversion: 2.1 time: 0.148087 Sep 07 16:03:49.214565 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 414/813] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:03:49 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:03:50.237054 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c4b0ceed-576e-45de-a350-7162eab27966 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:50.237661 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c4b0ceed-576e-45de-a350-7162eab27966 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:50.244046 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c4b0ceed-576e-45de-a350-7162eab27966 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:50.244526 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c4b0ceed-576e-45de-a350-7162eab27966 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:50.244965 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c4b0ceed-576e-45de-a350-7162eab27966 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:50.245665 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c4b0ceed-576e-45de-a350-7162eab27966 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:50.246119 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c4b0ceed-576e-45de-a350-7162eab27966 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:50.246543 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c4b0ceed-576e-45de-a350-7162eab27966 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:50.374277 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-c4b0ceed-576e-45de-a350-7162eab27966 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:50.381823 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c4b0ceed-576e-45de-a350-7162eab27966 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1680 microversion: 2.1 time: 0.148658 Sep 07 16:03:50.382377 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 400/814] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:03:50 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:03:51.405298 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-09a9d4e3-78ca-41ab-9b47-a8ff3fc3944a tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:51.405902 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-09a9d4e3-78ca-41ab-9b47-a8ff3fc3944a tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:51.412355 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09a9d4e3-78ca-41ab-9b47-a8ff3fc3944a tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:51.412775 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09a9d4e3-78ca-41ab-9b47-a8ff3fc3944a tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:51.413215 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09a9d4e3-78ca-41ab-9b47-a8ff3fc3944a tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:51.413900 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09a9d4e3-78ca-41ab-9b47-a8ff3fc3944a tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:51.414347 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09a9d4e3-78ca-41ab-9b47-a8ff3fc3944a tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:51.414771 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09a9d4e3-78ca-41ab-9b47-a8ff3fc3944a tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:51.538054 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-09a9d4e3-78ca-41ab-9b47-a8ff3fc3944a tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:51.545601 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-09a9d4e3-78ca-41ab-9b47-a8ff3fc3944a tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1680 microversion: 2.1 time: 0.144791 Sep 07 16:03:51.546158 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 415/815] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:03:51 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1680 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:03:52.568875 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c1213223-6f31-403f-bb7c-840b6ac07605 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:52.569480 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c1213223-6f31-403f-bb7c-840b6ac07605 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:52.575951 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c1213223-6f31-403f-bb7c-840b6ac07605 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:52.577078 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c1213223-6f31-403f-bb7c-840b6ac07605 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:52.577512 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c1213223-6f31-403f-bb7c-840b6ac07605 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:52.578193 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c1213223-6f31-403f-bb7c-840b6ac07605 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:52.578644 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c1213223-6f31-403f-bb7c-840b6ac07605 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:52.579062 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c1213223-6f31-403f-bb7c-840b6ac07605 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:52.703813 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-c1213223-6f31-403f-bb7c-840b6ac07605 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:52.711463 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c1213223-6f31-403f-bb7c-840b6ac07605 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1680 microversion: 2.1 time: 0.146558 Sep 07 16:03:52.712043 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 401/816] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:03:52 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1680 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:03:53.236883 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-af268a66-1041-4f78-9aa5-868070ac36e2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:53.237484 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-af268a66-1041-4f78-9aa5-868070ac36e2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:53.243803 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-af268a66-1041-4f78-9aa5-868070ac36e2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:53.244274 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-af268a66-1041-4f78-9aa5-868070ac36e2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:53.244706 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-af268a66-1041-4f78-9aa5-868070ac36e2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:53.245386 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-af268a66-1041-4f78-9aa5-868070ac36e2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:53.245823 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-af268a66-1041-4f78-9aa5-868070ac36e2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:53.246236 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-af268a66-1041-4f78-9aa5-868070ac36e2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:53.331775 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-af268a66-1041-4f78-9aa5-868070ac36e2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lazy-loading 'services' on Instance uuid 92a9f013-5f7f-442b-84d8-f61470d999ed {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 16:03:53.404604 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-af268a66-1041-4f78-9aa5-868070ac36e2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "DELETE /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed/os-volume_attachments/2c5475a1-db4f-42ac-8611-35f1b0a7a466" status: 202 len: 0 microversion: 2.1 time: 0.171990 Sep 07 16:03:53.405238 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 416/817] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Sep 7 16:03:53 2022] DELETE /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed/os-volume_attachments/2c5475a1-db4f-42ac-8611-35f1b0a7a466 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 16:03:53.414049 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-74468ba5-e1a1-4b20-82e6-8ea852c4d3bf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:53.416998 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-74468ba5-e1a1-4b20-82e6-8ea852c4d3bf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:53.422856 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-74468ba5-e1a1-4b20-82e6-8ea852c4d3bf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:53.423346 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-74468ba5-e1a1-4b20-82e6-8ea852c4d3bf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:53.423828 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-74468ba5-e1a1-4b20-82e6-8ea852c4d3bf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:53.424547 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-74468ba5-e1a1-4b20-82e6-8ea852c4d3bf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:53.425031 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-74468ba5-e1a1-4b20-82e6-8ea852c4d3bf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:53.425442 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-74468ba5-e1a1-4b20-82e6-8ea852c4d3bf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:53.458453 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-74468ba5-e1a1-4b20-82e6-8ea852c4d3bf tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048399 Sep 07 16:03:53.463488 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 402/818] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Sep 7 16:03:53 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:03:53.735276 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-21e1d1c1-ef61-4dfe-b44d-c7b70e64712f tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:53.735919 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-21e1d1c1-ef61-4dfe-b44d-c7b70e64712f tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:53.742023 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21e1d1c1-ef61-4dfe-b44d-c7b70e64712f tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:53.742500 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21e1d1c1-ef61-4dfe-b44d-c7b70e64712f tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:53.742934 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21e1d1c1-ef61-4dfe-b44d-c7b70e64712f tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:53.743709 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21e1d1c1-ef61-4dfe-b44d-c7b70e64712f tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:53.744164 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21e1d1c1-ef61-4dfe-b44d-c7b70e64712f tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:53.744587 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-21e1d1c1-ef61-4dfe-b44d-c7b70e64712f tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:53.871644 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-21e1d1c1-ef61-4dfe-b44d-c7b70e64712f tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:53.879806 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-21e1d1c1-ef61-4dfe-b44d-c7b70e64712f tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1680 microversion: 2.1 time: 0.148928 Sep 07 16:03:53.880362 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 417/819] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:03:53 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:03:54.470359 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5a501148-d6ef-4702-afe5-d8bfe56fb2d6 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:54.472564 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5a501148-d6ef-4702-afe5-d8bfe56fb2d6 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:54.479380 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a501148-d6ef-4702-afe5-d8bfe56fb2d6 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:54.479979 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a501148-d6ef-4702-afe5-d8bfe56fb2d6 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:54.480423 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a501148-d6ef-4702-afe5-d8bfe56fb2d6 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:54.481116 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a501148-d6ef-4702-afe5-d8bfe56fb2d6 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:54.481575 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a501148-d6ef-4702-afe5-d8bfe56fb2d6 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:54.482002 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5a501148-d6ef-4702-afe5-d8bfe56fb2d6 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:54.514073 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5a501148-d6ef-4702-afe5-d8bfe56fb2d6 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047634 Sep 07 16:03:54.514674 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 403/820] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Sep 7 16:03:54 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:03:54.902429 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-498f61e7-ea6e-49d0-94e2-fc0fc35e2827 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:54.903030 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-498f61e7-ea6e-49d0-94e2-fc0fc35e2827 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:54.909293 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-498f61e7-ea6e-49d0-94e2-fc0fc35e2827 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:54.909764 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-498f61e7-ea6e-49d0-94e2-fc0fc35e2827 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:54.910196 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-498f61e7-ea6e-49d0-94e2-fc0fc35e2827 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:54.910869 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-498f61e7-ea6e-49d0-94e2-fc0fc35e2827 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:54.911313 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-498f61e7-ea6e-49d0-94e2-fc0fc35e2827 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:54.911757 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-498f61e7-ea6e-49d0-94e2-fc0fc35e2827 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:55.037605 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-498f61e7-ea6e-49d0-94e2-fc0fc35e2827 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:55.045086 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-498f61e7-ea6e-49d0-94e2-fc0fc35e2827 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1680 microversion: 2.1 time: 0.146553 Sep 07 16:03:55.045642 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 418/821] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:03:54 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1680 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:03:55.526181 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7855da6d-f4c6-4085-9887-2fc071785256 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:55.528281 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7855da6d-f4c6-4085-9887-2fc071785256 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:55.535211 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7855da6d-f4c6-4085-9887-2fc071785256 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:55.535742 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7855da6d-f4c6-4085-9887-2fc071785256 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:55.536173 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7855da6d-f4c6-4085-9887-2fc071785256 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:55.536858 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7855da6d-f4c6-4085-9887-2fc071785256 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:55.537314 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7855da6d-f4c6-4085-9887-2fc071785256 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:55.537739 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7855da6d-f4c6-4085-9887-2fc071785256 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:55.566087 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7855da6d-f4c6-4085-9887-2fc071785256 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043915 Sep 07 16:03:55.566622 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 404/822] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Sep 7 16:03:55 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 16:03:55.645145 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4c4a47c1-3eb4-4c8b-9a0f-0bab890b98f0 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:55.645634 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4c4a47c1-3eb4-4c8b-9a0f-0bab890b98f0 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:55.651442 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c4a47c1-3eb4-4c8b-9a0f-0bab890b98f0 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:55.652060 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c4a47c1-3eb4-4c8b-9a0f-0bab890b98f0 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:55.652498 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c4a47c1-3eb4-4c8b-9a0f-0bab890b98f0 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:55.653203 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c4a47c1-3eb4-4c8b-9a0f-0bab890b98f0 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:55.653767 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c4a47c1-3eb4-4c8b-9a0f-0bab890b98f0 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:55.654308 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c4a47c1-3eb4-4c8b-9a0f-0bab890b98f0 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:55.680163 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4c4a47c1-3eb4-4c8b-9a0f-0bab890b98f0 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 16:03:55.751381 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4c4a47c1-3eb4-4c8b-9a0f-0bab890b98f0 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "DELETE /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed" status: 204 len: 0 microversion: 2.1 time: 0.109778 Sep 07 16:03:55.751977 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 419/823] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Sep 7 16:03:55 2022] DELETE /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 16:03:55.759972 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-910f6f9e-7374-4984-b80d-572590fbdb80 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:55.760577 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-910f6f9e-7374-4984-b80d-572590fbdb80 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:55.767830 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-910f6f9e-7374-4984-b80d-572590fbdb80 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:55.768581 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-910f6f9e-7374-4984-b80d-572590fbdb80 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:55.769251 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-910f6f9e-7374-4984-b80d-572590fbdb80 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:55.769939 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-910f6f9e-7374-4984-b80d-572590fbdb80 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:55.770391 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-910f6f9e-7374-4984-b80d-572590fbdb80 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:55.770814 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-910f6f9e-7374-4984-b80d-572590fbdb80 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:55.899035 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-910f6f9e-7374-4984-b80d-572590fbdb80 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:55.907439 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-910f6f9e-7374-4984-b80d-572590fbdb80 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed" status: 200 len: 1690 microversion: 2.1 time: 0.151252 Sep 07 16:03:55.907990 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 405/824] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:03:55 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed => generated 1690 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:03:56.068902 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-de266a91-fa0f-4f75-9604-753bf1a42374 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:56.069624 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-de266a91-fa0f-4f75-9604-753bf1a42374 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:56.075904 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de266a91-fa0f-4f75-9604-753bf1a42374 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:56.076388 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de266a91-fa0f-4f75-9604-753bf1a42374 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:56.076819 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de266a91-fa0f-4f75-9604-753bf1a42374 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:56.078112 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de266a91-fa0f-4f75-9604-753bf1a42374 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:56.078562 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de266a91-fa0f-4f75-9604-753bf1a42374 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:56.078988 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-de266a91-fa0f-4f75-9604-753bf1a42374 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:56.206185 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-de266a91-fa0f-4f75-9604-753bf1a42374 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:56.213800 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-de266a91-fa0f-4f75-9604-753bf1a42374 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1680 microversion: 2.1 time: 0.149103 Sep 07 16:03:56.214351 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 420/825] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:03:56 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:03:56.930051 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c051b9e9-c657-4dc5-8bac-f20a7fe3143d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:56.930658 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c051b9e9-c657-4dc5-8bac-f20a7fe3143d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:56.937060 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c051b9e9-c657-4dc5-8bac-f20a7fe3143d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:56.937540 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c051b9e9-c657-4dc5-8bac-f20a7fe3143d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:56.937972 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c051b9e9-c657-4dc5-8bac-f20a7fe3143d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:56.938645 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c051b9e9-c657-4dc5-8bac-f20a7fe3143d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:56.939096 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c051b9e9-c657-4dc5-8bac-f20a7fe3143d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:56.939512 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c051b9e9-c657-4dc5-8bac-f20a7fe3143d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:57.066532 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-c051b9e9-c657-4dc5-8bac-f20a7fe3143d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:57.074057 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c051b9e9-c657-4dc5-8bac-f20a7fe3143d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed" status: 200 len: 1690 microversion: 2.1 time: 0.147792 Sep 07 16:03:57.074604 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 406/826] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:03:56 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed => generated 1690 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:03:57.237098 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1e1d6e33-dccf-4ca9-b06c-848031f94651 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:57.237677 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1e1d6e33-dccf-4ca9-b06c-848031f94651 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:57.244041 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e1d6e33-dccf-4ca9-b06c-848031f94651 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:57.244524 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e1d6e33-dccf-4ca9-b06c-848031f94651 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:57.244964 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e1d6e33-dccf-4ca9-b06c-848031f94651 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:57.245673 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e1d6e33-dccf-4ca9-b06c-848031f94651 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:57.246128 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e1d6e33-dccf-4ca9-b06c-848031f94651 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:57.246563 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1e1d6e33-dccf-4ca9-b06c-848031f94651 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:57.373842 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1e1d6e33-dccf-4ca9-b06c-848031f94651 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:57.381415 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1e1d6e33-dccf-4ca9-b06c-848031f94651 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1680 microversion: 2.1 time: 0.148206 Sep 07 16:03:57.381974 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 421/827] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:03:57 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:03:58.096125 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8c566d11-574b-41cf-b1f5-42b13468960d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:58.096765 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8c566d11-574b-41cf-b1f5-42b13468960d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:58.103492 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8c566d11-574b-41cf-b1f5-42b13468960d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:58.104003 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8c566d11-574b-41cf-b1f5-42b13468960d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:58.104437 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8c566d11-574b-41cf-b1f5-42b13468960d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:58.105121 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8c566d11-574b-41cf-b1f5-42b13468960d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:58.105574 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8c566d11-574b-41cf-b1f5-42b13468960d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:58.105995 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8c566d11-574b-41cf-b1f5-42b13468960d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:58.235605 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-8c566d11-574b-41cf-b1f5-42b13468960d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:58.243289 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8c566d11-574b-41cf-b1f5-42b13468960d tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed" status: 200 len: 1690 microversion: 2.1 time: 0.151028 Sep 07 16:03:58.243877 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 407/828] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:03:58 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed => generated 1690 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:03:58.404738 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b1f72d0e-c9bf-4812-96da-2262b9ab9508 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:58.405756 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b1f72d0e-c9bf-4812-96da-2262b9ab9508 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:58.412243 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1f72d0e-c9bf-4812-96da-2262b9ab9508 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:58.412725 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1f72d0e-c9bf-4812-96da-2262b9ab9508 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:58.413160 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1f72d0e-c9bf-4812-96da-2262b9ab9508 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:58.413845 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1f72d0e-c9bf-4812-96da-2262b9ab9508 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:58.414296 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1f72d0e-c9bf-4812-96da-2262b9ab9508 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:58.414721 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b1f72d0e-c9bf-4812-96da-2262b9ab9508 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:58.540725 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b1f72d0e-c9bf-4812-96da-2262b9ab9508 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:58.548915 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b1f72d0e-c9bf-4812-96da-2262b9ab9508 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1680 microversion: 2.1 time: 0.148273 Sep 07 16:03:58.549475 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 422/829] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:03:58 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:03:59.267999 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9ad16976-1b1b-4c88-a980-898c5e05295e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:59.268607 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9ad16976-1b1b-4c88-a980-898c5e05295e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:59.275441 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9ad16976-1b1b-4c88-a980-898c5e05295e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:59.275962 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9ad16976-1b1b-4c88-a980-898c5e05295e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:59.276389 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9ad16976-1b1b-4c88-a980-898c5e05295e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:59.277112 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9ad16976-1b1b-4c88-a980-898c5e05295e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:59.277564 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9ad16976-1b1b-4c88-a980-898c5e05295e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:59.277984 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9ad16976-1b1b-4c88-a980-898c5e05295e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:59.571912 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bb39938b-c837-46a5-936b-170a36aef9b4 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:03:59.572541 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bb39938b-c837-46a5-936b-170a36aef9b4 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:03:59.579055 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb39938b-c837-46a5-936b-170a36aef9b4 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:59.579569 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb39938b-c837-46a5-936b-170a36aef9b4 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:59.580005 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb39938b-c837-46a5-936b-170a36aef9b4 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:59.580694 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb39938b-c837-46a5-936b-170a36aef9b4 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:03:59.581138 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb39938b-c837-46a5-936b-170a36aef9b4 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:03:59.581553 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb39938b-c837-46a5-936b-170a36aef9b4 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:03:59.717135 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-bb39938b-c837-46a5-936b-170a36aef9b4 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:59.725195 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bb39938b-c837-46a5-936b-170a36aef9b4 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1680 microversion: 2.1 time: 0.157128 Sep 07 16:03:59.725751 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 423/830] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:03:59 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 16:03:59.758939 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-9ad16976-1b1b-4c88-a980-898c5e05295e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:03:59.766732 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9ad16976-1b1b-4c88-a980-898c5e05295e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed" status: 200 len: 1690 microversion: 2.1 time: 0.503150 Sep 07 16:03:59.767387 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 408/831] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:03:59 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed => generated 1690 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:04:00.209728 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-648d33e8-f993-47c0-bad7-26aa698afd1c req-02e270cc-e696-4aff-8930-0ee2547896d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92a9f013-5f7f-442b-84d8-f61470d999ed", "name": "network-vif-deleted", "tag": "a060693c-99c1-4033-a3a8-1384e673c07a"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:04:00.219102 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-648d33e8-f993-47c0-bad7-26aa698afd1c req-02e270cc-e696-4aff-8930-0ee2547896d0 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:00.219601 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-648d33e8-f993-47c0-bad7-26aa698afd1c req-02e270cc-e696-4aff-8930-0ee2547896d0 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:00.220029 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-648d33e8-f993-47c0-bad7-26aa698afd1c req-02e270cc-e696-4aff-8930-0ee2547896d0 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:00.231326 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-648d33e8-f993-47c0-bad7-26aa698afd1c req-02e270cc-e696-4aff-8930-0ee2547896d0 service nova] Creating event network-vif-deleted:a060693c-99c1-4033-a3a8-1384e673c07a for instance 92a9f013-5f7f-442b-84d8-f61470d999ed on hv-cinder-85331 Sep 07 16:04:00.236884 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-648d33e8-f993-47c0-bad7-26aa698afd1c req-02e270cc-e696-4aff-8930-0ee2547896d0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030745 Sep 07 16:04:00.237812 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 424/832] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:04:00.749568 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-99b5816d-7176-431b-bf68-c09aef711cd1 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:04:00.750181 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-99b5816d-7176-431b-bf68-c09aef711cd1 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:04:00.756595 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99b5816d-7176-431b-bf68-c09aef711cd1 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:00.757084 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99b5816d-7176-431b-bf68-c09aef711cd1 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:00.757522 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99b5816d-7176-431b-bf68-c09aef711cd1 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:00.758213 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99b5816d-7176-431b-bf68-c09aef711cd1 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:00.758667 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99b5816d-7176-431b-bf68-c09aef711cd1 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:00.759094 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99b5816d-7176-431b-bf68-c09aef711cd1 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:00.791182 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4522b47f-4056-4efc-b007-3b7762d1b039 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:04:00.792559 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4522b47f-4056-4efc-b007-3b7762d1b039 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:04:00.800051 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4522b47f-4056-4efc-b007-3b7762d1b039 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:00.803076 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4522b47f-4056-4efc-b007-3b7762d1b039 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:00.803076 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4522b47f-4056-4efc-b007-3b7762d1b039 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:00.803076 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4522b47f-4056-4efc-b007-3b7762d1b039 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:00.803076 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4522b47f-4056-4efc-b007-3b7762d1b039 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:00.803585 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4522b47f-4056-4efc-b007-3b7762d1b039 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:00.806950 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:04:00.839680 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4522b47f-4056-4efc-b007-3b7762d1b039 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:00.840273 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4522b47f-4056-4efc-b007-3b7762d1b039 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:00.840787 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4522b47f-4056-4efc-b007-3b7762d1b039 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:00.841370 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-4522b47f-4056-4efc-b007-3b7762d1b039 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lazy-loading 'fault' on Instance uuid 92a9f013-5f7f-442b-84d8-f61470d999ed {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 16:04:00.884277 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-4522b47f-4056-4efc-b007-3b7762d1b039 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:04:00.892943 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4522b47f-4056-4efc-b007-3b7762d1b039 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed" status: 200 len: 1334 microversion: 2.1 time: 0.105796 Sep 07 16:04:00.894068 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 425/833] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:04:00 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed => generated 1334 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 16:04:00.910975 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-99b5816d-7176-431b-bf68-c09aef711cd1 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:04:00.919736 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-99b5816d-7176-431b-bf68-c09aef711cd1 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1657 microversion: 2.1 time: 0.173917 Sep 07 16:04:00.938167 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 409/834] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:04:00 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1657 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:04:00.943594 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c7c534aa-2949-4567-a41f-925cfe3b4622 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:04:00.950927 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c7c534aa-2949-4567-a41f-925cfe3b4622 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:00.951342 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c7c534aa-2949-4567-a41f-925cfe3b4622 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:00.952815 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c7c534aa-2949-4567-a41f-925cfe3b4622 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:00.978916 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c7c534aa-2949-4567-a41f-925cfe3b4622 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Going to try to start instance {{(pid=120640) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 07 16:04:01.025476 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c7c534aa-2949-4567-a41f-925cfe3b4622 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "POST /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14/action" status: 202 len: 0 microversion: 2.1 time: 0.085637 Sep 07 16:04:01.026343 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 426/835] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Sep 7 16:04:00 2022] POST /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 16:04:01.034269 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dc6694c2-6f8d-4bd5-ac5d-3fb460187253 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:04:01.034890 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-dc6694c2-6f8d-4bd5-ac5d-3fb460187253 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:04:01.040921 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dc6694c2-6f8d-4bd5-ac5d-3fb460187253 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:01.041417 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dc6694c2-6f8d-4bd5-ac5d-3fb460187253 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:01.042054 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dc6694c2-6f8d-4bd5-ac5d-3fb460187253 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:01.042804 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dc6694c2-6f8d-4bd5-ac5d-3fb460187253 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:01.043255 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dc6694c2-6f8d-4bd5-ac5d-3fb460187253 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:01.043711 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dc6694c2-6f8d-4bd5-ac5d-3fb460187253 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:01.189163 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-dc6694c2-6f8d-4bd5-ac5d-3fb460187253 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:04:01.197161 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-dc6694c2-6f8d-4bd5-ac5d-3fb460187253 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1666 microversion: 2.1 time: 0.166633 Sep 07 16:04:01.197905 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 410/836] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:04:01 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1666 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:04:01.917986 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3cbdb24a-ddb4-4930-a016-b767864739d9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:04:01.918690 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3cbdb24a-ddb4-4930-a016-b767864739d9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 92a9f013-5f7f-442b-84d8-f61470d999ed] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:04:01.924926 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3cbdb24a-ddb4-4930-a016-b767864739d9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:01.925409 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3cbdb24a-ddb4-4930-a016-b767864739d9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:01.925847 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3cbdb24a-ddb4-4930-a016-b767864739d9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:01.926532 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3cbdb24a-ddb4-4930-a016-b767864739d9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:01.926986 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3cbdb24a-ddb4-4930-a016-b767864739d9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:01.927416 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3cbdb24a-ddb4-4930-a016-b767864739d9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:01.940691 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-3cbdb24a-ddb4-4930-a016-b767864739d9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] HTTP exception thrown: Instance 92a9f013-5f7f-442b-84d8-f61470d999ed could not be found. Sep 07 16:04:01.942304 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3cbdb24a-ddb4-4930-a016-b767864739d9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Request method failure captured: Sep 07 16:04:01.942304 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed HTTP/1.1 Sep 07 16:04:01.942304 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept: application/json Sep 07 16:04:01.942304 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Sep 07 16:04:01.942304 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Connection: close Sep 07 16:04:01.942304 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Length: 0 Sep 07 16:04:01.942304 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Type: application/json Sep 07 16:04:01.942304 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Host: 10.222.0.17 Sep 07 16:04:01.942304 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Sep 07 16:04:01.942304 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Sep 07 16:04:01.942304 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjGL8U3olZ2_NAu3h9ENgyu4mlOOEiN-5DzVT5ll2l4CQG1Al6-WZd8sJsfCXeHe8dqFbg7WeRmYV8ndjIQ3HiKhv70Sq_aPzDk3HT2nFi-G2crlFv8gLLPy9OLuVpMJdSfFhXkgQ7qyX93ubFTTXV_nBx0wb_NUMh1jc8VKXNTsHIdKw Sep 07 16:04:01.942304 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Sep 07 16:04:01.942304 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Sep 07 16:04:01.942304 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Sep 07 16:04:01.942304 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Sep 07 16:04:01.942304 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Sep 07 16:04:01.942304 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Sep 07 16:04:01.942304 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Id: 20596aac52254a159269aa634116f080 Sep 07 16:04:01.942304 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1951895607 Sep 07 16:04:01.942304 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Role: reader,member Sep 07 16:04:01.942304 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Roles: reader,member Sep 07 16:04:01.943963 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_20596aac52254a159269aa634116f080", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/20596aac52254a159269aa634116f080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/20596aac52254a159269aa634116f080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/20596aac52254a159269aa634116f080"}]}] Sep 07 16:04:01.943963 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1951895607 Sep 07 16:04:01.943963 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Id: 20596aac52254a159269aa634116f080 Sep 07 16:04:01.943963 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1951895607 Sep 07 16:04:01.943963 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User: tempest-ServerRescueNegativeTestJSON-1951895607-project Sep 07 16:04:01.943963 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Sep 07 16:04:01.943963 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Sep 07 16:04:01.943963 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Id: 7dc84ece6eb84315b54defd89be8a95c Sep 07 16:04:01.943963 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1951895607-project Sep 07 16:04:01.943963 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: method: > Sep 07 16:04:01.943963 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: exception: Instance 92a9f013-5f7f-442b-84d8-f61470d999ed could not be found. Sep 07 16:04:01.943963 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: action_args: {'id': '92a9f013-5f7f-442b-84d8-f61470d999ed'} Sep 07 16:04:01.944903 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 16:04:01.944903 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:04:01.944903 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 16:04:01.944903 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 16:04:01.944903 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 16:04:01.944903 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 16:04:01.944903 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 16:04:01.944903 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 16:04:01.944903 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 16:04:01.944903 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 16:04:01.944903 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92a9f013-5f7f-442b-84d8-f61470d999ed could not be found. Sep 07 16:04:01.944903 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:04:01.944903 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:04:01.944903 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:04:01.944903 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:04:01.944903 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:04:01.944903 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:04:01.944903 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 16:04:01.944903 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 16:04:01.944903 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 16:04:01.946419 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 16:04:01.946419 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 16:04:01.946419 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 16:04:01.946419 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 16:04:01.946419 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 16:04:01.946419 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 16:04:01.946419 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 16:04:01.946419 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92a9f013-5f7f-442b-84d8-f61470d999ed could not be found. Sep 07 16:04:01.946419 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:04:01.946419 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:04:01.946419 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:04:01.946419 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:04:01.946419 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:04:01.946419 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:04:01.946419 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 16:04:01.946419 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 16:04:01.946419 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92a9f013-5f7f-442b-84d8-f61470d999ed could not be found. Sep 07 16:04:01.946419 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:04:01.947929 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3cbdb24a-ddb4-4930-a016-b767864739d9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Returning 404 to user: Instance 92a9f013-5f7f-442b-84d8-f61470d999ed could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 16:04:01.947929 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3cbdb24a-ddb4-4930-a016-b767864739d9 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed" status: 404 len: 111 microversion: 2.1 time: 0.030367 Sep 07 16:04:01.947929 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 427/837] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:04:01 2022] GET /compute/v2.1/servers/92a9f013-5f7f-442b-84d8-f61470d999ed => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 16:04:01.952779 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d0fc07cf-147e-43ae-8dde-c4a202430984 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '.version_select at 0x7ff9a5ba80d0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:04:01.971323 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d0fc07cf-147e-43ae-8dde-c4a202430984 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-381695792" status: 202 len: 0 microversion: 2.1 time: 0.022843 Sep 07 16:04:01.971903 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 411/838] 10.222.0.17 () {58 vars in 1218 bytes} [Wed Sep 7 16:04:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-381695792 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 16:04:02.220842 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3e598cbc-c693-4a95-9657-0b2949d11a91 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:04:02.221365 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3e598cbc-c693-4a95-9657-0b2949d11a91 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:04:02.228030 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e598cbc-c693-4a95-9657-0b2949d11a91 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:02.228515 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e598cbc-c693-4a95-9657-0b2949d11a91 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:02.228946 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e598cbc-c693-4a95-9657-0b2949d11a91 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:02.229646 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e598cbc-c693-4a95-9657-0b2949d11a91 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:02.230247 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e598cbc-c693-4a95-9657-0b2949d11a91 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:02.230671 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3e598cbc-c693-4a95-9657-0b2949d11a91 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:02.615185 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3e598cbc-c693-4a95-9657-0b2949d11a91 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:04:02.623036 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3e598cbc-c693-4a95-9657-0b2949d11a91 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1666 microversion: 2.1 time: 0.406439 Sep 07 16:04:02.623661 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 428/839] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:04:02 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1666 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:04:03.646591 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-172d1493-f09a-41a5-ae21-f3cee2b4dea0 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:04:03.647228 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-172d1493-f09a-41a5-ae21-f3cee2b4dea0 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:04:03.654276 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-172d1493-f09a-41a5-ae21-f3cee2b4dea0 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:03.654747 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-172d1493-f09a-41a5-ae21-f3cee2b4dea0 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:03.655824 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-172d1493-f09a-41a5-ae21-f3cee2b4dea0 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:03.656606 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-172d1493-f09a-41a5-ae21-f3cee2b4dea0 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:03.657067 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-172d1493-f09a-41a5-ae21-f3cee2b4dea0 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:03.657527 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-172d1493-f09a-41a5-ae21-f3cee2b4dea0 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:03.781441 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-172d1493-f09a-41a5-ae21-f3cee2b4dea0 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:04:03.789053 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-172d1493-f09a-41a5-ae21-f3cee2b4dea0 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1670 microversion: 2.1 time: 0.146779 Sep 07 16:04:03.789618 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 412/840] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:04:03 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1670 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:04:05.161785 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-170ee311-89b1-4fcf-b273-7c4626633011 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:04:05.162279 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-170ee311-89b1-4fcf-b273-7c4626633011 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:04:05.168802 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-170ee311-89b1-4fcf-b273-7c4626633011 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:05.169281 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-170ee311-89b1-4fcf-b273-7c4626633011 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:05.169714 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-170ee311-89b1-4fcf-b273-7c4626633011 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:05.170407 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-170ee311-89b1-4fcf-b273-7c4626633011 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:05.171474 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-170ee311-89b1-4fcf-b273-7c4626633011 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:05.171926 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-170ee311-89b1-4fcf-b273-7c4626633011 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:05.196760 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-170ee311-89b1-4fcf-b273-7c4626633011 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 16:04:05.269907 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-170ee311-89b1-4fcf-b273-7c4626633011 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "DELETE /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 204 len: 0 microversion: 2.1 time: 0.111749 Sep 07 16:04:05.270476 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 429/841] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Sep 7 16:04:05 2022] DELETE /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 16:04:05.278621 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c0076492-d056-4652-9489-18c5217127a2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:04:05.279241 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c0076492-d056-4652-9489-18c5217127a2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:04:05.286352 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c0076492-d056-4652-9489-18c5217127a2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:05.286839 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c0076492-d056-4652-9489-18c5217127a2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:05.287281 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c0076492-d056-4652-9489-18c5217127a2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:05.288004 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c0076492-d056-4652-9489-18c5217127a2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:05.288465 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c0076492-d056-4652-9489-18c5217127a2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:05.288894 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c0076492-d056-4652-9489-18c5217127a2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:05.308156 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:04:05.427537 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-c0076492-d056-4652-9489-18c5217127a2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:04:05.435232 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c0076492-d056-4652-9489-18c5217127a2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1508 microversion: 2.1 time: 0.160538 Sep 07 16:04:05.435820 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 413/842] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:04:05 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:04:06.459251 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6014bd10-e505-48fe-8efc-0a9171905e13 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:04:06.459889 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6014bd10-e505-48fe-8efc-0a9171905e13 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:04:06.466210 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6014bd10-e505-48fe-8efc-0a9171905e13 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:06.466686 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6014bd10-e505-48fe-8efc-0a9171905e13 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:06.467121 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6014bd10-e505-48fe-8efc-0a9171905e13 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:06.468418 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6014bd10-e505-48fe-8efc-0a9171905e13 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:06.468873 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6014bd10-e505-48fe-8efc-0a9171905e13 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:06.469323 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6014bd10-e505-48fe-8efc-0a9171905e13 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:06.597063 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6014bd10-e505-48fe-8efc-0a9171905e13 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:04:06.605001 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6014bd10-e505-48fe-8efc-0a9171905e13 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1508 microversion: 2.1 time: 0.150020 Sep 07 16:04:06.605554 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 430/843] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:04:06 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:04:06.974373 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-86124df1-ec4c-4510-8e2b-0d6dedcfd0ce req-72352716-41a1-4db7-878e-faa83c96fb6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "546eacb2-a6cd-44c7-8abf-97798497d947", "name": "network-vif-deleted", "tag": "aa591f91-fdf7-4476-bfea-32a7fbad414b"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:04:06.985197 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-86124df1-ec4c-4510-8e2b-0d6dedcfd0ce req-72352716-41a1-4db7-878e-faa83c96fb6e service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:06.985675 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-86124df1-ec4c-4510-8e2b-0d6dedcfd0ce req-72352716-41a1-4db7-878e-faa83c96fb6e service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:06.986104 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-86124df1-ec4c-4510-8e2b-0d6dedcfd0ce req-72352716-41a1-4db7-878e-faa83c96fb6e service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:06.997887 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-86124df1-ec4c-4510-8e2b-0d6dedcfd0ce req-72352716-41a1-4db7-878e-faa83c96fb6e service nova] Creating event network-vif-deleted:aa591f91-fdf7-4476-bfea-32a7fbad414b for instance 546eacb2-a6cd-44c7-8abf-97798497d947 on hv-cinder-85331 Sep 07 16:04:07.004143 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-86124df1-ec4c-4510-8e2b-0d6dedcfd0ce req-72352716-41a1-4db7-878e-faa83c96fb6e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033389 Sep 07 16:04:07.004524 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 414/844] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:04:07.627284 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-885de376-762c-4e3c-b3f9-72af9552c146 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:04:07.627878 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-885de376-762c-4e3c-b3f9-72af9552c146 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:04:07.634180 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-885de376-762c-4e3c-b3f9-72af9552c146 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:07.634665 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-885de376-762c-4e3c-b3f9-72af9552c146 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:07.635099 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-885de376-762c-4e3c-b3f9-72af9552c146 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:07.635826 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-885de376-762c-4e3c-b3f9-72af9552c146 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:07.636281 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-885de376-762c-4e3c-b3f9-72af9552c146 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:07.636706 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-885de376-762c-4e3c-b3f9-72af9552c146 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:07.668777 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-885de376-762c-4e3c-b3f9-72af9552c146 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:07.669256 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-885de376-762c-4e3c-b3f9-72af9552c146 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:07.669687 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-885de376-762c-4e3c-b3f9-72af9552c146 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:07.670127 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-885de376-762c-4e3c-b3f9-72af9552c146 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lazy-loading 'fault' on Instance uuid 546eacb2-a6cd-44c7-8abf-97798497d947 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 16:04:07.710277 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-885de376-762c-4e3c-b3f9-72af9552c146 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:04:07.719806 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-885de376-762c-4e3c-b3f9-72af9552c146 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 200 len: 1312 microversion: 2.1 time: 0.096260 Sep 07 16:04:07.720295 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 431/845] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:04:07 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 1312 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:04:08.743982 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8ddb9a45-7bf7-4b71-9e21-60d099d4c93e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:04:08.744683 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8ddb9a45-7bf7-4b71-9e21-60d099d4c93e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: 546eacb2-a6cd-44c7-8abf-97798497d947] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:04:08.750784 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8ddb9a45-7bf7-4b71-9e21-60d099d4c93e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:08.751270 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8ddb9a45-7bf7-4b71-9e21-60d099d4c93e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:08.751740 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8ddb9a45-7bf7-4b71-9e21-60d099d4c93e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:08.752429 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8ddb9a45-7bf7-4b71-9e21-60d099d4c93e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:08.752889 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8ddb9a45-7bf7-4b71-9e21-60d099d4c93e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:08.753315 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8ddb9a45-7bf7-4b71-9e21-60d099d4c93e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:08.766208 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-8ddb9a45-7bf7-4b71-9e21-60d099d4c93e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] HTTP exception thrown: Instance 546eacb2-a6cd-44c7-8abf-97798497d947 could not be found. Sep 07 16:04:08.767833 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8ddb9a45-7bf7-4b71-9e21-60d099d4c93e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Request method failure captured: Sep 07 16:04:08.767833 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 HTTP/1.1 Sep 07 16:04:08.767833 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Accept: application/json Sep 07 16:04:08.767833 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Accept-Encoding: identity Sep 07 16:04:08.767833 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Connection: close Sep 07 16:04:08.767833 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Content-Length: 0 Sep 07 16:04:08.767833 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Content-Type: application/json Sep 07 16:04:08.767833 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Host: 10.222.0.17 Sep 07 16:04:08.767833 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Openstack-System-Scope: None Sep 07 16:04:08.767833 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Sep 07 16:04:08.767833 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjGL8U3olZ2_NAu3h9ENgyu4mlOOEiN-5DzVT5ll2l4CQG1Al6-WZd8sJsfCXeHe8dqFbg7WeRmYV8ndjIQ3HiKhv70Sq_aPzDk3HT2nFi-G2crlFv8gLLPy9OLuVpMJdSfFhXkgQ7qyX93ubFTTXV_nBx0wb_NUMh1jc8VKXNTsHIdKw Sep 07 16:04:08.767833 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Domain-Id: None Sep 07 16:04:08.767833 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Domain-Name: None Sep 07 16:04:08.767833 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Identity-Status: Confirmed Sep 07 16:04:08.767833 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Is-Admin-Project: True Sep 07 16:04:08.767833 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Domain-Id: default Sep 07 16:04:08.767833 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Domain-Name: Default Sep 07 16:04:08.767833 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Id: 20596aac52254a159269aa634116f080 Sep 07 16:04:08.767833 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1951895607 Sep 07 16:04:08.767833 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Role: reader,member Sep 07 16:04:08.767833 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Roles: reader,member Sep 07 16:04:08.769379 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_20596aac52254a159269aa634116f080", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/20596aac52254a159269aa634116f080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/20596aac52254a159269aa634116f080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/20596aac52254a159269aa634116f080"}]}] Sep 07 16:04:08.769379 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1951895607 Sep 07 16:04:08.769379 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant-Id: 20596aac52254a159269aa634116f080 Sep 07 16:04:08.769379 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1951895607 Sep 07 16:04:08.769379 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User: tempest-ServerRescueNegativeTestJSON-1951895607-project Sep 07 16:04:08.769379 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Domain-Id: default Sep 07 16:04:08.769379 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Domain-Name: Default Sep 07 16:04:08.769379 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Id: 7dc84ece6eb84315b54defd89be8a95c Sep 07 16:04:08.769379 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1951895607-project Sep 07 16:04:08.769379 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: method: > Sep 07 16:04:08.769379 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: exception: Instance 546eacb2-a6cd-44c7-8abf-97798497d947 could not be found. Sep 07 16:04:08.769379 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: action_args: {'id': '546eacb2-a6cd-44c7-8abf-97798497d947'} Sep 07 16:04:08.770238 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 16:04:08.770238 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:04:08.770238 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 16:04:08.770238 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 16:04:08.770238 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 16:04:08.770238 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 16:04:08.770238 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 16:04:08.770238 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 16:04:08.770238 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 16:04:08.770238 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 16:04:08.770238 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 546eacb2-a6cd-44c7-8abf-97798497d947 could not be found. Sep 07 16:04:08.770238 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:04:08.770238 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:04:08.770238 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:04:08.770238 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:04:08.770238 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:04:08.770238 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:04:08.770238 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 16:04:08.770238 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 16:04:08.770238 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 16:04:08.771772 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 16:04:08.771772 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 16:04:08.771772 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 16:04:08.771772 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 16:04:08.771772 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 16:04:08.771772 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 16:04:08.771772 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 16:04:08.771772 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 546eacb2-a6cd-44c7-8abf-97798497d947 could not be found. Sep 07 16:04:08.771772 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:04:08.771772 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:04:08.771772 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:04:08.771772 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:04:08.771772 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:04:08.771772 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:04:08.771772 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 16:04:08.771772 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 16:04:08.771772 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 546eacb2-a6cd-44c7-8abf-97798497d947 could not be found. Sep 07 16:04:08.771772 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:04:08.773145 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8ddb9a45-7bf7-4b71-9e21-60d099d4c93e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Returning 404 to user: Instance 546eacb2-a6cd-44c7-8abf-97798497d947 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 16:04:08.773145 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8ddb9a45-7bf7-4b71-9e21-60d099d4c93e tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947" status: 404 len: 111 microversion: 2.1 time: 0.029992 Sep 07 16:04:08.773145 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 415/846] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:04:08 2022] GET /compute/v2.1/servers/546eacb2-a6cd-44c7-8abf-97798497d947 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 16:04:08.777583 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-35a0db2e-b826-4868-9df5-97798953076a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:04:08.778146 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-35a0db2e-b826-4868-9df5-97798953076a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: f39427e6-62a5-4a4e-96e8-644f03653722] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:04:08.784908 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35a0db2e-b826-4868-9df5-97798953076a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:08.785380 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35a0db2e-b826-4868-9df5-97798953076a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:08.785810 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35a0db2e-b826-4868-9df5-97798953076a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:08.786485 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35a0db2e-b826-4868-9df5-97798953076a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:08.786929 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35a0db2e-b826-4868-9df5-97798953076a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:08.787347 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35a0db2e-b826-4868-9df5-97798953076a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:08.812032 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-35a0db2e-b826-4868-9df5-97798953076a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: f39427e6-62a5-4a4e-96e8-644f03653722] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 16:04:08.884803 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-35a0db2e-b826-4868-9df5-97798953076a tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722" status: 204 len: 0 microversion: 2.1 time: 0.110646 Sep 07 16:04:08.887082 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 432/847] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Sep 7 16:04:08 2022] DELETE /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 16:04:08.897217 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c94cadeb-ff07-44e0-9b46-c7ef26c30a36 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:04:08.898301 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c94cadeb-ff07-44e0-9b46-c7ef26c30a36 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: f39427e6-62a5-4a4e-96e8-644f03653722] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:04:08.904655 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c94cadeb-ff07-44e0-9b46-c7ef26c30a36 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:08.905659 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c94cadeb-ff07-44e0-9b46-c7ef26c30a36 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:08.906102 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c94cadeb-ff07-44e0-9b46-c7ef26c30a36 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:08.906801 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c94cadeb-ff07-44e0-9b46-c7ef26c30a36 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:08.907258 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c94cadeb-ff07-44e0-9b46-c7ef26c30a36 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:08.907827 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c94cadeb-ff07-44e0-9b46-c7ef26c30a36 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:09.040163 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-c94cadeb-ff07-44e0-9b46-c7ef26c30a36 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:04:09.048335 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c94cadeb-ff07-44e0-9b46-c7ef26c30a36 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722" status: 200 len: 1521 microversion: 2.1 time: 0.157203 Sep 07 16:04:09.048909 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 416/848] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:04:08 2022] GET /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 16:04:10.070675 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-290a05dc-0960-4447-afb5-8b6422fc14e2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:04:10.071479 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-290a05dc-0960-4447-afb5-8b6422fc14e2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: f39427e6-62a5-4a4e-96e8-644f03653722] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:04:10.077721 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-290a05dc-0960-4447-afb5-8b6422fc14e2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:10.078248 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-290a05dc-0960-4447-afb5-8b6422fc14e2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:10.078678 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-290a05dc-0960-4447-afb5-8b6422fc14e2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:10.079357 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-290a05dc-0960-4447-afb5-8b6422fc14e2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:10.079832 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-290a05dc-0960-4447-afb5-8b6422fc14e2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:10.080251 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-290a05dc-0960-4447-afb5-8b6422fc14e2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:10.209932 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-290a05dc-0960-4447-afb5-8b6422fc14e2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc84ece6eb84315b54defd89be8a95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20596aac52254a159269aa634116f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:04:10.217694 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-290a05dc-0960-4447-afb5-8b6422fc14e2 tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722" status: 200 len: 1521 microversion: 2.1 time: 0.151231 Sep 07 16:04:10.218472 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 433/849] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:04:10 2022] GET /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:04:10.439334 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-6125eb4e-dba8-426f-8842-bdbdddabb379 req-2ac52a0f-f671-4d27-afd0-2ac2cd0bc5c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f39427e6-62a5-4a4e-96e8-644f03653722", "name": "network-vif-deleted", "tag": "c1b41643-a122-48be-8241-42826288f60e"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:04:10.451518 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-6125eb4e-dba8-426f-8842-bdbdddabb379 req-2ac52a0f-f671-4d27-afd0-2ac2cd0bc5c2 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:10.452035 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-6125eb4e-dba8-426f-8842-bdbdddabb379 req-2ac52a0f-f671-4d27-afd0-2ac2cd0bc5c2 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:10.452467 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-6125eb4e-dba8-426f-8842-bdbdddabb379 req-2ac52a0f-f671-4d27-afd0-2ac2cd0bc5c2 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:10.465758 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-6125eb4e-dba8-426f-8842-bdbdddabb379 req-2ac52a0f-f671-4d27-afd0-2ac2cd0bc5c2 service nova] Creating event network-vif-deleted:c1b41643-a122-48be-8241-42826288f60e for instance f39427e6-62a5-4a4e-96e8-644f03653722 on hv-cinder-85331 Sep 07 16:04:10.471112 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-6125eb4e-dba8-426f-8842-bdbdddabb379 req-2ac52a0f-f671-4d27-afd0-2ac2cd0bc5c2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035990 Sep 07 16:04:10.471729 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 417/850] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:04:11.241190 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-556e9027-7f73-4e5f-a409-22bc25bc3c0c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:04:11.241793 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-556e9027-7f73-4e5f-a409-22bc25bc3c0c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] [instance: f39427e6-62a5-4a4e-96e8-644f03653722] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:04:11.248404 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-556e9027-7f73-4e5f-a409-22bc25bc3c0c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:11.248887 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-556e9027-7f73-4e5f-a409-22bc25bc3c0c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:11.249325 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-556e9027-7f73-4e5f-a409-22bc25bc3c0c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:11.250014 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-556e9027-7f73-4e5f-a409-22bc25bc3c0c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:11.250463 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-556e9027-7f73-4e5f-a409-22bc25bc3c0c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:11.251386 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-556e9027-7f73-4e5f-a409-22bc25bc3c0c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:11.264365 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-556e9027-7f73-4e5f-a409-22bc25bc3c0c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] HTTP exception thrown: Instance f39427e6-62a5-4a4e-96e8-644f03653722 could not be found. Sep 07 16:04:11.266000 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-556e9027-7f73-4e5f-a409-22bc25bc3c0c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Request method failure captured: Sep 07 16:04:11.266000 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722 HTTP/1.1 Sep 07 16:04:11.266000 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept: application/json Sep 07 16:04:11.266000 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Sep 07 16:04:11.266000 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Connection: close Sep 07 16:04:11.266000 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Length: 0 Sep 07 16:04:11.266000 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Type: application/json Sep 07 16:04:11.266000 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Host: 10.222.0.17 Sep 07 16:04:11.266000 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Sep 07 16:04:11.266000 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Sep 07 16:04:11.266000 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjGL8U3olZ2_NAu3h9ENgyu4mlOOEiN-5DzVT5ll2l4CQG1Al6-WZd8sJsfCXeHe8dqFbg7WeRmYV8ndjIQ3HiKhv70Sq_aPzDk3HT2nFi-G2crlFv8gLLPy9OLuVpMJdSfFhXkgQ7qyX93ubFTTXV_nBx0wb_NUMh1jc8VKXNTsHIdKw Sep 07 16:04:11.266000 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Sep 07 16:04:11.266000 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Sep 07 16:04:11.266000 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Sep 07 16:04:11.266000 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Sep 07 16:04:11.266000 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Sep 07 16:04:11.266000 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Sep 07 16:04:11.266000 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Id: 20596aac52254a159269aa634116f080 Sep 07 16:04:11.266000 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1951895607 Sep 07 16:04:11.266000 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Role: reader,member Sep 07 16:04:11.266000 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Roles: reader,member Sep 07 16:04:11.268294 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_20596aac52254a159269aa634116f080", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/20596aac52254a159269aa634116f080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/20596aac52254a159269aa634116f080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/20596aac52254a159269aa634116f080"}]}] Sep 07 16:04:11.268294 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1951895607 Sep 07 16:04:11.268294 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Id: 20596aac52254a159269aa634116f080 Sep 07 16:04:11.268294 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1951895607 Sep 07 16:04:11.268294 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User: tempest-ServerRescueNegativeTestJSON-1951895607-project Sep 07 16:04:11.268294 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Sep 07 16:04:11.268294 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Sep 07 16:04:11.268294 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Id: 7dc84ece6eb84315b54defd89be8a95c Sep 07 16:04:11.268294 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1951895607-project Sep 07 16:04:11.268294 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: method: > Sep 07 16:04:11.268294 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: exception: Instance f39427e6-62a5-4a4e-96e8-644f03653722 could not be found. Sep 07 16:04:11.268294 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: action_args: {'id': 'f39427e6-62a5-4a4e-96e8-644f03653722'} Sep 07 16:04:11.269063 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 16:04:11.269063 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:04:11.269063 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 16:04:11.269063 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 16:04:11.269063 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 16:04:11.269063 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 16:04:11.269063 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 16:04:11.269063 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 16:04:11.269063 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 16:04:11.269063 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 16:04:11.269063 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f39427e6-62a5-4a4e-96e8-644f03653722 could not be found. Sep 07 16:04:11.269063 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:04:11.269063 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:04:11.269063 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:04:11.269063 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:04:11.269063 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:04:11.269063 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:04:11.269063 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 16:04:11.269063 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 16:04:11.269063 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 16:04:11.270617 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 16:04:11.270617 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 16:04:11.270617 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 16:04:11.270617 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 16:04:11.270617 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 16:04:11.270617 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 16:04:11.270617 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 16:04:11.270617 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f39427e6-62a5-4a4e-96e8-644f03653722 could not be found. Sep 07 16:04:11.270617 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:04:11.270617 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:04:11.270617 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:04:11.270617 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:04:11.270617 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:04:11.270617 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:04:11.270617 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 16:04:11.270617 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 16:04:11.270617 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f39427e6-62a5-4a4e-96e8-644f03653722 could not be found. Sep 07 16:04:11.270617 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:04:11.272132 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-556e9027-7f73-4e5f-a409-22bc25bc3c0c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] Returning 404 to user: Instance f39427e6-62a5-4a4e-96e8-644f03653722 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 16:04:11.272132 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-556e9027-7f73-4e5f-a409-22bc25bc3c0c tempest-ServerRescueNegativeTestJSON-1951895607 tempest-ServerRescueNegativeTestJSON-1951895607-project] 10.222.0.17 "GET /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722" status: 404 len: 111 microversion: 2.1 time: 0.030642 Sep 07 16:04:11.272132 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 434/851] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:04:11 2022] GET /compute/v2.1/servers/f39427e6-62a5-4a4e-96e8-644f03653722 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 16:04:18.834705 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-50c82316-be8d-4dc2-bd37-0ced06062420 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-528386023"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:04:18.835510 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-50c82316-be8d-4dc2-bd37-0ced06062420 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:04:18.837359 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:04:18.845001 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-50c82316-be8d-4dc2-bd37-0ced06062420 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:18.846208 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-50c82316-be8d-4dc2-bd37-0ced06062420 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:18.846869 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-50c82316-be8d-4dc2-bd37-0ced06062420 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:18.848023 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-50c82316-be8d-4dc2-bd37-0ced06062420 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:18.849410 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-50c82316-be8d-4dc2-bd37-0ced06062420 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:18.850527 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-50c82316-be8d-4dc2-bd37-0ced06062420 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:19.085637 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.network.security_group_api [None req-50c82316-be8d-4dc2-bd37-0ced06062420 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Removing security group b179cd52-ee11-4033-87c3-79fa1bb4e12f from port 62d356d3-a43c-486d-a45b-1855b53e8a1d Sep 07 16:04:19.677588 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-50c82316-be8d-4dc2-bd37-0ced06062420 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "POST /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33/action" status: 202 len: 0 microversion: 2.1 time: 1.062998 Sep 07 16:04:19.683099 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 418/852] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Sep 7 16:04:18 2022] POST /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33/action => generated 0 bytes in 1069 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 16:04:19.694109 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-b898decc-ea51-4f7f-aae9-f41479b91a29 req-63b5661d-180e-48e1-ba64-c38c52b88ebb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84743d24-2644-46a9-86a3-030706f2ec33", "tag": "62d356d3-a43c-486d-a45b-1855b53e8a1d"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:04:19.734344 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:04:19.753842 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-b898decc-ea51-4f7f-aae9-f41479b91a29 req-63b5661d-180e-48e1-ba64-c38c52b88ebb service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:19.754347 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-b898decc-ea51-4f7f-aae9-f41479b91a29 req-63b5661d-180e-48e1-ba64-c38c52b88ebb service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:19.755117 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-b898decc-ea51-4f7f-aae9-f41479b91a29 req-63b5661d-180e-48e1-ba64-c38c52b88ebb service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:19.779845 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-b898decc-ea51-4f7f-aae9-f41479b91a29 req-63b5661d-180e-48e1-ba64-c38c52b88ebb service nova] Creating event network-changed:62d356d3-a43c-486d-a45b-1855b53e8a1d for instance 84743d24-2644-46a9-86a3-030706f2ec33 on hv-cinder-85331 Sep 07 16:04:19.793265 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-b898decc-ea51-4f7f-aae9-f41479b91a29 req-63b5661d-180e-48e1-ba64-c38c52b88ebb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103017 Sep 07 16:04:19.798693 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 435/853] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:04:20.741242 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bb0babfd-d561-4b53-a551-d2e7ed301ded tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Action: 'create', calling method: .version_select at 0x7ff9a5ba4a60>, body: {"keypair": {"name": "tempest-keypair-1700250870", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPU3VDWVH7rACK7kuLGnFBm1fYnUckPcbTwERwqRJiJXz2EwOfToK2e4mkb1ftPX+W9UDVk01SWKlscgBMT7lRCRZc6ZMMlgow8rGWFXE/p4WRVTfmSuLZUJD3Pd7Q5hg=="}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:04:20.757851 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.quota [None req-bb0babfd-d561-4b53-a551-d2e7ed301ded tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Getting quotas for project ab1963a1a6684af58f5c240787788b60. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 16:04:20.762256 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.quota [None req-bb0babfd-d561-4b53-a551-d2e7ed301ded tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Getting quotas for user 2dab44e593194fe788216b029eecd10c and project ab1963a1a6684af58f5c240787788b60. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 16:04:20.788442 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bb0babfd-d561-4b53-a551-d2e7ed301ded tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.104432 Sep 07 16:04:20.789047 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 419/854] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Sep 7 16:04:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:04:21.595833 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0276c504-e55f-45bb-924f-13e8ea5a7599 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:04:21.596417 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0276c504-e55f-45bb-924f-13e8ea5a7599 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:04:21.605374 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0276c504-e55f-45bb-924f-13e8ea5a7599 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:21.605876 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0276c504-e55f-45bb-924f-13e8ea5a7599 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:21.606373 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0276c504-e55f-45bb-924f-13e8ea5a7599 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:21.607090 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0276c504-e55f-45bb-924f-13e8ea5a7599 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:21.607622 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0276c504-e55f-45bb-924f-13e8ea5a7599 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:21.608058 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0276c504-e55f-45bb-924f-13e8ea5a7599 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:21.745951 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-0276c504-e55f-45bb-924f-13e8ea5a7599 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lazy-loading 'services' on Instance uuid 84743d24-2644-46a9-86a3-030706f2ec33 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 16:04:21.818420 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-934ca126-3f01-4e24-a22b-8c5ff8b30a8d req-abbe0ad7-605d-46f1-bc40-27a5cdf48746 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84743d24-2644-46a9-86a3-030706f2ec33", "tag": "62d356d3-a43c-486d-a45b-1855b53e8a1d"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:04:21.830555 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-934ca126-3f01-4e24-a22b-8c5ff8b30a8d req-abbe0ad7-605d-46f1-bc40-27a5cdf48746 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:21.831053 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-934ca126-3f01-4e24-a22b-8c5ff8b30a8d req-abbe0ad7-605d-46f1-bc40-27a5cdf48746 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:21.831490 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-934ca126-3f01-4e24-a22b-8c5ff8b30a8d req-abbe0ad7-605d-46f1-bc40-27a5cdf48746 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:21.854692 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-934ca126-3f01-4e24-a22b-8c5ff8b30a8d req-abbe0ad7-605d-46f1-bc40-27a5cdf48746 service nova] Creating event network-changed:62d356d3-a43c-486d-a45b-1855b53e8a1d for instance 84743d24-2644-46a9-86a3-030706f2ec33 on hv-cinder-85331 Sep 07 16:04:21.879096 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0276c504-e55f-45bb-924f-13e8ea5a7599 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "DELETE /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33/os-volume_attachments/9eff6d69-019c-4757-9508-e9c4008deff6" status: 202 len: 0 microversion: 2.1 time: 0.287299 Sep 07 16:04:21.880112 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-934ca126-3f01-4e24-a22b-8c5ff8b30a8d req-abbe0ad7-605d-46f1-bc40-27a5cdf48746 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066630 Sep 07 16:04:21.881515 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 436/855] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Sep 7 16:04:21 2022] DELETE /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33/os-volume_attachments/9eff6d69-019c-4757-9508-e9c4008deff6 => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 16:04:21.885786 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 420/856] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 16:04:21.892914 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2fe9f60c-9b47-43eb-8a20-a16380bf3d5b tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:04:21.896120 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2fe9f60c-9b47-43eb-8a20-a16380bf3d5b tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:04:21.902634 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2fe9f60c-9b47-43eb-8a20-a16380bf3d5b tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:21.903123 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2fe9f60c-9b47-43eb-8a20-a16380bf3d5b tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:21.903594 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2fe9f60c-9b47-43eb-8a20-a16380bf3d5b tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:21.904311 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2fe9f60c-9b47-43eb-8a20-a16380bf3d5b tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:21.904932 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2fe9f60c-9b47-43eb-8a20-a16380bf3d5b tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:21.905365 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2fe9f60c-9b47-43eb-8a20-a16380bf3d5b tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:21.976880 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2fe9f60c-9b47-43eb-8a20-a16380bf3d5b tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089921 Sep 07 16:04:21.977811 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 437/857] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Sep 7 16:04:21 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:04:22.313177 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5c59501d-0c0b-4d90-9071-5cd041bdb475 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2031270799", "imageRef": "cfe19284-9779-46f4-b458-81d5475ec82f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "de0a3fba-a9f9-45bf-aa74-cb5014a191cb"}], "security_groups": [{"name": "tempest-securitygroup--1908417913"}], "key_name": "tempest-keypair-1700250870", "user_data": "}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:04:22.426621 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-5c59501d-0c0b-4d90-9071-5cd041bdb475 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] validate_networks() for [('de0a3fba-a9f9-45bf-aa74-cb5014a191cb', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 16:04:22.990121 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-22c6a59e-6c19-474e-abc2-58eae4d5953c tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:04:22.992439 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-22c6a59e-6c19-474e-abc2-58eae4d5953c tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:04:23.009256 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22c6a59e-6c19-474e-abc2-58eae4d5953c tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:23.009759 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22c6a59e-6c19-474e-abc2-58eae4d5953c tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:23.010202 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22c6a59e-6c19-474e-abc2-58eae4d5953c tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:23.010913 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22c6a59e-6c19-474e-abc2-58eae4d5953c tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:23.011368 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22c6a59e-6c19-474e-abc2-58eae4d5953c tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:23.016676 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-22c6a59e-6c19-474e-abc2-58eae4d5953c tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:23.021578 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:04:23.052603 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-22c6a59e-6c19-474e-abc2-58eae4d5953c tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066394 Sep 07 16:04:23.053280 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 438/858] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Sep 7 16:04:22 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 16:04:23.064511 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-62e48d3a-7440-49ca-a780-fa2129257422 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:04:23.065206 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-62e48d3a-7440-49ca-a780-fa2129257422 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:04:23.071184 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62e48d3a-7440-49ca-a780-fa2129257422 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:23.071733 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62e48d3a-7440-49ca-a780-fa2129257422 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:23.072157 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62e48d3a-7440-49ca-a780-fa2129257422 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:23.072852 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62e48d3a-7440-49ca-a780-fa2129257422 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:23.073305 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62e48d3a-7440-49ca-a780-fa2129257422 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:23.073897 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-62e48d3a-7440-49ca-a780-fa2129257422 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:23.107225 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-5c59501d-0c0b-4d90-9071-5cd041bdb475 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 16:04:23.107762 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-5c59501d-0c0b-4d90-9071-5cd041bdb475 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 16:04:23.108247 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-5c59501d-0c0b-4d90-9071-5cd041bdb475 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 16:04:23.108669 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-5c59501d-0c0b-4d90-9071-5cd041bdb475 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 16:04:23.109084 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-5c59501d-0c0b-4d90-9071-5cd041bdb475 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 16:04:23.120866 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5c59501d-0c0b-4d90-9071-5cd041bdb475 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:23.121351 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5c59501d-0c0b-4d90-9071-5cd041bdb475 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:23.121789 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5c59501d-0c0b-4d90-9071-5cd041bdb475 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:23.123421 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5c59501d-0c0b-4d90-9071-5cd041bdb475 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:23.124216 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5c59501d-0c0b-4d90-9071-5cd041bdb475 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:23.124849 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5c59501d-0c0b-4d90-9071-5cd041bdb475 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:23.143350 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.quota [None req-5c59501d-0c0b-4d90-9071-5cd041bdb475 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Getting quotas for project ab1963a1a6684af58f5c240787788b60. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 16:04:23.147897 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.quota [None req-5c59501d-0c0b-4d90-9071-5cd041bdb475 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Getting quotas for user 2dab44e593194fe788216b029eecd10c and project ab1963a1a6684af58f5c240787788b60. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 16:04:23.161251 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5c59501d-0c0b-4d90-9071-5cd041bdb475 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 16:04:23.163516 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5c59501d-0c0b-4d90-9071-5cd041bdb475 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 8ae4d7f1-1422-4346-84ab-72682ad0a928] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cfe19284-9779-46f4-b458-81d5475ec82f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 16:04:23.181169 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-62e48d3a-7440-49ca-a780-fa2129257422 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] HTTP exception thrown: Instance 84743d24-2644-46a9-86a3-030706f2ec33 is not attached to volume 9eff6d69-019c-4757-9508-e9c4008deff6 Sep 07 16:04:23.188091 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-62e48d3a-7440-49ca-a780-fa2129257422 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Request method failure captured: Sep 07 16:04:23.188091 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: request: DELETE /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33/os-volume_attachments/9eff6d69-019c-4757-9508-e9c4008deff6 HTTP/1.1 Sep 07 16:04:23.188091 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept: application/json Sep 07 16:04:23.188091 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Sep 07 16:04:23.188091 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Connection: close Sep 07 16:04:23.188091 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Length: 0 Sep 07 16:04:23.188091 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Type: application/json Sep 07 16:04:23.188091 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Host: 10.222.0.17 Sep 07 16:04:23.188091 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Sep 07 16:04:23.188091 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Sep 07 16:04:23.188091 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjGL-mkQuI5cs_qAfaJs_4CvRgCY9HgQ5KQ45uMTLZiX37G4skiHL-FlPXlJiaOSQ9SYJvkzkQbgIhe8bo_CwiIXjAxC67oxu45LLDZiRShxb-nfrMDlVWrNgwbKVgnKCfM8UVwr4sxBYyjA4w-GsO85P9mJE0OBLaAIes9POrgHB4ZFI Sep 07 16:04:23.188091 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Sep 07 16:04:23.188091 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Sep 07 16:04:23.188091 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Sep 07 16:04:23.188091 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Sep 07 16:04:23.188091 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Sep 07 16:04:23.188091 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Sep 07 16:04:23.188091 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Id: e0fa130dded4449b88e5d696f57a6a1d Sep 07 16:04:23.188091 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-TestMinimumBasicScenario-42502982 Sep 07 16:04:23.188091 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Role: reader,member Sep 07 16:04:23.188091 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Roles: reader,member Sep 07 16:04:23.189563 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e0fa130dded4449b88e5d696f57a6a1d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e0fa130dded4449b88e5d696f57a6a1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e0fa130dded4449b88e5d696f57a6a1d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e0fa130dded4449b88e5d696f57a6a1d"}]}] Sep 07 16:04:23.189563 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-TestMinimumBasicScenario-42502982 Sep 07 16:04:23.189563 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Id: e0fa130dded4449b88e5d696f57a6a1d Sep 07 16:04:23.189563 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-TestMinimumBasicScenario-42502982 Sep 07 16:04:23.189563 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User: tempest-TestMinimumBasicScenario-42502982-project Sep 07 16:04:23.189563 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Sep 07 16:04:23.189563 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Sep 07 16:04:23.189563 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Id: c1320dca5c1840f9af2418e705e8aaa1 Sep 07 16:04:23.189563 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-TestMinimumBasicScenario-42502982-project Sep 07 16:04:23.189563 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: method: > Sep 07 16:04:23.189563 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: exception: Instance 84743d24-2644-46a9-86a3-030706f2ec33 is not attached to volume 9eff6d69-019c-4757-9508-e9c4008deff6 Sep 07 16:04:23.190280 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: action_args: {'server_id': '84743d24-2644-46a9-86a3-030706f2ec33', 'id': '9eff6d69-019c-4757-9508-e9c4008deff6'} Sep 07 16:04:23.190280 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 16:04:23.190280 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:04:23.190280 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 07 16:04:23.190280 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 07 16:04:23.190280 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 16:04:23.190280 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 16:04:23.190280 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 07 16:04:23.190280 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 07 16:04:23.190280 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 9eff6d69-019c-4757-9508-e9c4008deff6. Sep 07 16:04:23.190280 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:04:23.190280 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:04:23.190280 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:04:23.190280 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:04:23.190280 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:04:23.190280 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:04:23.190280 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 16:04:23.190280 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 16:04:23.190280 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 16:04:23.191424 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 16:04:23.191424 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 07 16:04:23.191424 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 07 16:04:23.191424 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84743d24-2644-46a9-86a3-030706f2ec33 is not attached to volume 9eff6d69-019c-4757-9508-e9c4008deff6 Sep 07 16:04:23.191424 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:04:23.191424 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:04:23.191424 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:04:23.191424 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:04:23.191424 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:04:23.191424 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:04:23.191424 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 16:04:23.191424 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 16:04:23.191424 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84743d24-2644-46a9-86a3-030706f2ec33 is not attached to volume 9eff6d69-019c-4757-9508-e9c4008deff6 Sep 07 16:04:23.191424 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:04:23.191424 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-62e48d3a-7440-49ca-a780-fa2129257422 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Returning 404 to user: Instance 84743d24-2644-46a9-86a3-030706f2ec33 is not attached to volume 9eff6d69-019c-4757-9508-e9c4008deff6 {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 16:04:23.192375 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-62e48d3a-7440-49ca-a780-fa2129257422 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "DELETE /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33/os-volume_attachments/9eff6d69-019c-4757-9508-e9c4008deff6" status: 404 len: 154 microversion: 2.1 time: 0.129640 Sep 07 16:04:23.192375 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 439/859] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Sep 7 16:04:23 2022] DELETE /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33/os-volume_attachments/9eff6d69-019c-4757-9508-e9c4008deff6 => generated 154 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 16:04:23.222084 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5c59501d-0c0b-4d90-9071-5cd041bdb475 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.913849 Sep 07 16:04:23.229530 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 421/860] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Sep 7 16:04:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 923 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 07 16:04:23.234284 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-16b6e259-0bbf-489a-bc89-e96c8cf14e55 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:04:23.235829 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-16b6e259-0bbf-489a-bc89-e96c8cf14e55 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 8ae4d7f1-1422-4346-84ab-72682ad0a928] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:04:23.316196 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-16b6e259-0bbf-489a-bc89-e96c8cf14e55 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:04:23.339769 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-16b6e259-0bbf-489a-bc89-e96c8cf14e55 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928" status: 200 len: 1242 microversion: 2.1 time: 0.109280 Sep 07 16:04:23.356078 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 440/861] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:04:23 2022] GET /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928 => generated 1242 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 16:04:24.364607 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0a2bee4d-b44a-456e-a8fe-29097e658824 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:04:24.365292 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1bae655a-0777-42de-b8ea-fc153c4bc728 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:04:24.365692 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0a2bee4d-b44a-456e-a8fe-29097e658824 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 8ae4d7f1-1422-4346-84ab-72682ad0a928] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:04:24.365848 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1bae655a-0777-42de-b8ea-fc153c4bc728 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:04:24.372479 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1bae655a-0777-42de-b8ea-fc153c4bc728 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:24.372969 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1bae655a-0777-42de-b8ea-fc153c4bc728 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:24.373185 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0a2bee4d-b44a-456e-a8fe-29097e658824 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:24.373399 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1bae655a-0777-42de-b8ea-fc153c4bc728 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:24.373677 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0a2bee4d-b44a-456e-a8fe-29097e658824 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:24.374114 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0a2bee4d-b44a-456e-a8fe-29097e658824 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:24.374291 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1bae655a-0777-42de-b8ea-fc153c4bc728 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:24.374914 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1bae655a-0777-42de-b8ea-fc153c4bc728 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:24.375101 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0a2bee4d-b44a-456e-a8fe-29097e658824 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:24.375341 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1bae655a-0777-42de-b8ea-fc153c4bc728 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:24.375588 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0a2bee4d-b44a-456e-a8fe-29097e658824 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:24.376021 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0a2bee4d-b44a-456e-a8fe-29097e658824 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:24.402744 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1bae655a-0777-42de-b8ea-fc153c4bc728 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 16:04:24.459398 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-0a2bee4d-b44a-456e-a8fe-29097e658824 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:04:24.468046 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0a2bee4d-b44a-456e-a8fe-29097e658824 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928" status: 200 len: 1238 microversion: 2.1 time: 0.107453 Sep 07 16:04:24.468609 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 422/862] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:04:24 2022] GET /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928 => generated 1238 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:04:24.491144 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1bae655a-0777-42de-b8ea-fc153c4bc728 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "DELETE /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 204 len: 0 microversion: 2.1 time: 0.129318 Sep 07 16:04:24.491762 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 441/863] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Sep 7 16:04:24 2022] DELETE /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 16:04:24.500827 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0e5c536f-74af-4572-93a7-1cb36f8e739f tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:04:24.501440 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0e5c536f-74af-4572-93a7-1cb36f8e739f tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:04:24.508271 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e5c536f-74af-4572-93a7-1cb36f8e739f tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:24.509046 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e5c536f-74af-4572-93a7-1cb36f8e739f tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:24.509489 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e5c536f-74af-4572-93a7-1cb36f8e739f tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:24.510194 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e5c536f-74af-4572-93a7-1cb36f8e739f tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:24.510649 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e5c536f-74af-4572-93a7-1cb36f8e739f tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:24.511271 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0e5c536f-74af-4572-93a7-1cb36f8e739f tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:24.639649 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-0e5c536f-74af-4572-93a7-1cb36f8e739f tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:04:24.647957 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0e5c536f-74af-4572-93a7-1cb36f8e739f tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1554 microversion: 2.1 time: 0.151678 Sep 07 16:04:24.648523 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 423/864] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:04:24 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 16:04:25.493795 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-eb5cb302-93d9-4b90-b087-c6bbeb1678aa tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:04:25.494687 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-eb5cb302-93d9-4b90-b087-c6bbeb1678aa tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 8ae4d7f1-1422-4346-84ab-72682ad0a928] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:04:25.501088 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb5cb302-93d9-4b90-b087-c6bbeb1678aa tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:25.501640 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb5cb302-93d9-4b90-b087-c6bbeb1678aa tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:25.502322 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb5cb302-93d9-4b90-b087-c6bbeb1678aa tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:25.503077 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb5cb302-93d9-4b90-b087-c6bbeb1678aa tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:25.503626 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb5cb302-93d9-4b90-b087-c6bbeb1678aa tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:25.504135 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb5cb302-93d9-4b90-b087-c6bbeb1678aa tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:25.574046 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-eb5cb302-93d9-4b90-b087-c6bbeb1678aa tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:04:25.582263 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-eb5cb302-93d9-4b90-b087-c6bbeb1678aa tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928" status: 200 len: 1294 microversion: 2.1 time: 0.092725 Sep 07 16:04:25.582818 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 442/865] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:04:25 2022] GET /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928 => generated 1294 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:04:25.671639 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-05abc28b-2a20-4fa5-a2fe-87acd351eef4 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:04:25.672247 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-05abc28b-2a20-4fa5-a2fe-87acd351eef4 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:04:25.678620 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-05abc28b-2a20-4fa5-a2fe-87acd351eef4 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:25.679092 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-05abc28b-2a20-4fa5-a2fe-87acd351eef4 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:25.679520 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-05abc28b-2a20-4fa5-a2fe-87acd351eef4 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:25.680222 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-05abc28b-2a20-4fa5-a2fe-87acd351eef4 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:25.680672 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-05abc28b-2a20-4fa5-a2fe-87acd351eef4 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:25.681087 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-05abc28b-2a20-4fa5-a2fe-87acd351eef4 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:25.805065 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-05abc28b-2a20-4fa5-a2fe-87acd351eef4 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:04:25.812858 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-05abc28b-2a20-4fa5-a2fe-87acd351eef4 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1554 microversion: 2.1 time: 0.144999 Sep 07 16:04:25.813417 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 424/866] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:04:25 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1554 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:04:26.605716 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f860af7b-3015-451b-8438-c3548ef7a188 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:04:26.606240 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f860af7b-3015-451b-8438-c3548ef7a188 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 8ae4d7f1-1422-4346-84ab-72682ad0a928] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:04:26.613192 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f860af7b-3015-451b-8438-c3548ef7a188 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:26.613669 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f860af7b-3015-451b-8438-c3548ef7a188 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:26.614102 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f860af7b-3015-451b-8438-c3548ef7a188 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:26.614781 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f860af7b-3015-451b-8438-c3548ef7a188 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:26.615229 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f860af7b-3015-451b-8438-c3548ef7a188 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:26.615676 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f860af7b-3015-451b-8438-c3548ef7a188 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:26.679953 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f860af7b-3015-451b-8438-c3548ef7a188 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:04:26.688343 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f860af7b-3015-451b-8438-c3548ef7a188 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928" status: 200 len: 1294 microversion: 2.1 time: 0.085981 Sep 07 16:04:26.688897 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 443/867] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:04:26 2022] GET /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928 => generated 1294 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:04:26.835882 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ac68f304-51c0-424a-bef2-a111039142db tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:04:26.836485 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ac68f304-51c0-424a-bef2-a111039142db tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:04:26.842856 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ac68f304-51c0-424a-bef2-a111039142db tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:26.843335 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ac68f304-51c0-424a-bef2-a111039142db tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:26.844308 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ac68f304-51c0-424a-bef2-a111039142db tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:26.845004 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ac68f304-51c0-424a-bef2-a111039142db tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:26.845452 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ac68f304-51c0-424a-bef2-a111039142db tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:26.845866 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ac68f304-51c0-424a-bef2-a111039142db tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:27.009824 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-ac68f304-51c0-424a-bef2-a111039142db tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:04:27.017570 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ac68f304-51c0-424a-bef2-a111039142db tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1554 microversion: 2.1 time: 0.185631 Sep 07 16:04:27.018133 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 425/868] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:04:26 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1554 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:04:27.485954 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-82858a5a-3f45-48d5-a98c-145632427c12 req-63289e4a-9265-4e8c-82aa-378d1ece5c3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84743d24-2644-46a9-86a3-030706f2ec33", "name": "network-vif-deleted", "tag": "62d356d3-a43c-486d-a45b-1855b53e8a1d"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:04:27.497328 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-82858a5a-3f45-48d5-a98c-145632427c12 req-63289e4a-9265-4e8c-82aa-378d1ece5c3b service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:27.497801 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-82858a5a-3f45-48d5-a98c-145632427c12 req-63289e4a-9265-4e8c-82aa-378d1ece5c3b service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:27.498359 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-82858a5a-3f45-48d5-a98c-145632427c12 req-63289e4a-9265-4e8c-82aa-378d1ece5c3b service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:27.515121 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-82858a5a-3f45-48d5-a98c-145632427c12 req-63289e4a-9265-4e8c-82aa-378d1ece5c3b service nova] Creating event network-vif-deleted:62d356d3-a43c-486d-a45b-1855b53e8a1d for instance 84743d24-2644-46a9-86a3-030706f2ec33 on hv-cinder-85331 Sep 07 16:04:27.521841 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-82858a5a-3f45-48d5-a98c-145632427c12 req-63289e4a-9265-4e8c-82aa-378d1ece5c3b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041488 Sep 07 16:04:27.522817 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 444/869] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 16:04:27.710250 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-465fd242-852d-453e-ae7c-e7e32cb618d4 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:04:27.711134 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-465fd242-852d-453e-ae7c-e7e32cb618d4 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 8ae4d7f1-1422-4346-84ab-72682ad0a928] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:04:27.717014 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-465fd242-852d-453e-ae7c-e7e32cb618d4 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:27.717501 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-465fd242-852d-453e-ae7c-e7e32cb618d4 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:27.717934 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-465fd242-852d-453e-ae7c-e7e32cb618d4 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:27.718615 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-465fd242-852d-453e-ae7c-e7e32cb618d4 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:27.719266 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-465fd242-852d-453e-ae7c-e7e32cb618d4 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:27.719893 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-465fd242-852d-453e-ae7c-e7e32cb618d4 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:27.872474 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-465fd242-852d-453e-ae7c-e7e32cb618d4 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:04:27.883154 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-465fd242-852d-453e-ae7c-e7e32cb618d4 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928" status: 200 len: 1368 microversion: 2.1 time: 0.176204 Sep 07 16:04:27.883886 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 426/870] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:04:27 2022] GET /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928 => generated 1368 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:04:28.042284 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2c0d6681-8557-419f-b43d-ceacbe8abb97 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:04:28.043082 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2c0d6681-8557-419f-b43d-ceacbe8abb97 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:04:28.049763 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c0d6681-8557-419f-b43d-ceacbe8abb97 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:28.050306 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c0d6681-8557-419f-b43d-ceacbe8abb97 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:28.050802 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c0d6681-8557-419f-b43d-ceacbe8abb97 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:28.051574 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c0d6681-8557-419f-b43d-ceacbe8abb97 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:28.052098 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c0d6681-8557-419f-b43d-ceacbe8abb97 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:28.052581 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c0d6681-8557-419f-b43d-ceacbe8abb97 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:28.082592 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c0d6681-8557-419f-b43d-ceacbe8abb97 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:28.083269 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c0d6681-8557-419f-b43d-ceacbe8abb97 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:28.083730 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2c0d6681-8557-419f-b43d-ceacbe8abb97 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:28.084174 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-2c0d6681-8557-419f-b43d-ceacbe8abb97 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lazy-loading 'fault' on Instance uuid 84743d24-2644-46a9-86a3-030706f2ec33 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 16:04:28.153981 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2c0d6681-8557-419f-b43d-ceacbe8abb97 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1320dca5c1840f9af2418e705e8aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0fa130dded4449b88e5d696f57a6a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:04:28.162561 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2c0d6681-8557-419f-b43d-ceacbe8abb97 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 200 len: 1348 microversion: 2.1 time: 0.124923 Sep 07 16:04:28.163138 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 445/871] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:04:28 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 1348 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:04:28.553313 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-3acf7195-da88-4e87-8b6e-ac0b8bdf2a03 req-4af8123c-a317-476f-ba42-4dd65e6cbb07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ae4d7f1-1422-4346-84ab-72682ad0a928", "tag": "564cc98f-00eb-466c-b68e-33eaa3b07be5"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:04:28.562950 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-3acf7195-da88-4e87-8b6e-ac0b8bdf2a03 req-4af8123c-a317-476f-ba42-4dd65e6cbb07 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:28.563431 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-3acf7195-da88-4e87-8b6e-ac0b8bdf2a03 req-4af8123c-a317-476f-ba42-4dd65e6cbb07 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:28.563886 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-3acf7195-da88-4e87-8b6e-ac0b8bdf2a03 req-4af8123c-a317-476f-ba42-4dd65e6cbb07 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:28.575647 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-3acf7195-da88-4e87-8b6e-ac0b8bdf2a03 req-4af8123c-a317-476f-ba42-4dd65e6cbb07 service nova] Creating event network-changed:564cc98f-00eb-466c-b68e-33eaa3b07be5 for instance 8ae4d7f1-1422-4346-84ab-72682ad0a928 on hv-cinder-85331 Sep 07 16:04:28.580914 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-3acf7195-da88-4e87-8b6e-ac0b8bdf2a03 req-4af8123c-a317-476f-ba42-4dd65e6cbb07 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031410 Sep 07 16:04:28.581501 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 427/872] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:04:28.906155 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d37a196b-2114-4e20-a490-e28628355305 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:04:28.907326 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d37a196b-2114-4e20-a490-e28628355305 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 8ae4d7f1-1422-4346-84ab-72682ad0a928] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:04:28.909498 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 16:04:28.909905 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Wed Sep 7 16:04:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928 (ip 10.222.0.17) !!! Sep 07 16:04:28.922002 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d37a196b-2114-4e20-a490-e28628355305 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:28.922492 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d37a196b-2114-4e20-a490-e28628355305 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:28.922932 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d37a196b-2114-4e20-a490-e28628355305 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:28.923659 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d37a196b-2114-4e20-a490-e28628355305 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:28.924112 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d37a196b-2114-4e20-a490-e28628355305 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:28.924539 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d37a196b-2114-4e20-a490-e28628355305 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:29.088862 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d37a196b-2114-4e20-a490-e28628355305 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:04:29.096568 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d37a196b-2114-4e20-a490-e28628355305 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928" status: 200 len: 1368 microversion: 2.1 time: 0.194236 Sep 07 16:04:29.097130 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 446/873] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:04:28 2022] GET /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928 => generated 1368 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 16:04:29.188095 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c163cf27-c61c-4153-a0d8-ee5917b7ad9d tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:04:29.188800 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c163cf27-c61c-4153-a0d8-ee5917b7ad9d tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] [instance: 84743d24-2644-46a9-86a3-030706f2ec33] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:04:29.194944 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c163cf27-c61c-4153-a0d8-ee5917b7ad9d tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:29.195429 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c163cf27-c61c-4153-a0d8-ee5917b7ad9d tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:29.195893 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c163cf27-c61c-4153-a0d8-ee5917b7ad9d tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:29.196587 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c163cf27-c61c-4153-a0d8-ee5917b7ad9d tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:29.197047 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c163cf27-c61c-4153-a0d8-ee5917b7ad9d tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:29.197477 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c163cf27-c61c-4153-a0d8-ee5917b7ad9d tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:29.211074 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-c163cf27-c61c-4153-a0d8-ee5917b7ad9d tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] HTTP exception thrown: Instance 84743d24-2644-46a9-86a3-030706f2ec33 could not be found. Sep 07 16:04:29.212834 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c163cf27-c61c-4153-a0d8-ee5917b7ad9d tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Request method failure captured: Sep 07 16:04:29.212834 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 HTTP/1.1 Sep 07 16:04:29.212834 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Accept: application/json Sep 07 16:04:29.212834 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Accept-Encoding: identity Sep 07 16:04:29.212834 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Connection: close Sep 07 16:04:29.212834 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Content-Length: 0 Sep 07 16:04:29.212834 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Content-Type: application/json Sep 07 16:04:29.212834 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Host: 10.222.0.17 Sep 07 16:04:29.212834 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Openstack-System-Scope: None Sep 07 16:04:29.212834 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Sep 07 16:04:29.212834 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjGL-mkQuI5cs_qAfaJs_4CvRgCY9HgQ5KQ45uMTLZiX37G4skiHL-FlPXlJiaOSQ9SYJvkzkQbgIhe8bo_CwiIXjAxC67oxu45LLDZiRShxb-nfrMDlVWrNgwbKVgnKCfM8UVwr4sxBYyjA4w-GsO85P9mJE0OBLaAIes9POrgHB4ZFI Sep 07 16:04:29.212834 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Domain-Id: None Sep 07 16:04:29.212834 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Domain-Name: None Sep 07 16:04:29.212834 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Identity-Status: Confirmed Sep 07 16:04:29.212834 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Is-Admin-Project: True Sep 07 16:04:29.212834 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Domain-Id: default Sep 07 16:04:29.212834 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Domain-Name: Default Sep 07 16:04:29.212834 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Id: e0fa130dded4449b88e5d696f57a6a1d Sep 07 16:04:29.212834 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Name: tempest-TestMinimumBasicScenario-42502982 Sep 07 16:04:29.212834 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Role: reader,member Sep 07 16:04:29.212834 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Roles: reader,member Sep 07 16:04:29.214504 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e0fa130dded4449b88e5d696f57a6a1d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e0fa130dded4449b88e5d696f57a6a1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e0fa130dded4449b88e5d696f57a6a1d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e0fa130dded4449b88e5d696f57a6a1d"}]}] Sep 07 16:04:29.214504 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant: tempest-TestMinimumBasicScenario-42502982 Sep 07 16:04:29.214504 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant-Id: e0fa130dded4449b88e5d696f57a6a1d Sep 07 16:04:29.214504 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant-Name: tempest-TestMinimumBasicScenario-42502982 Sep 07 16:04:29.214504 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User: tempest-TestMinimumBasicScenario-42502982-project Sep 07 16:04:29.214504 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Domain-Id: default Sep 07 16:04:29.214504 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Domain-Name: Default Sep 07 16:04:29.214504 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Id: c1320dca5c1840f9af2418e705e8aaa1 Sep 07 16:04:29.214504 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Name: tempest-TestMinimumBasicScenario-42502982-project Sep 07 16:04:29.214504 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: method: > Sep 07 16:04:29.214504 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: exception: Instance 84743d24-2644-46a9-86a3-030706f2ec33 could not be found. Sep 07 16:04:29.214504 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: action_args: {'id': '84743d24-2644-46a9-86a3-030706f2ec33'} Sep 07 16:04:29.215686 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 16:04:29.215686 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:04:29.215686 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 16:04:29.215686 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 16:04:29.215686 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 16:04:29.215686 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 16:04:29.215686 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 16:04:29.215686 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 16:04:29.215686 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 16:04:29.215686 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 16:04:29.215686 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84743d24-2644-46a9-86a3-030706f2ec33 could not be found. Sep 07 16:04:29.215686 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:04:29.215686 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:04:29.215686 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:04:29.215686 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:04:29.215686 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:04:29.215686 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:04:29.215686 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 16:04:29.215686 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 16:04:29.215686 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 16:04:29.217266 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 16:04:29.217266 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 16:04:29.217266 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 16:04:29.217266 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 16:04:29.217266 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 16:04:29.217266 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 16:04:29.217266 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 16:04:29.217266 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84743d24-2644-46a9-86a3-030706f2ec33 could not be found. Sep 07 16:04:29.217266 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:04:29.217266 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:04:29.217266 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:04:29.217266 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:04:29.217266 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:04:29.217266 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:04:29.217266 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 16:04:29.217266 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 16:04:29.217266 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84743d24-2644-46a9-86a3-030706f2ec33 could not be found. Sep 07 16:04:29.217266 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:04:29.218684 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c163cf27-c61c-4153-a0d8-ee5917b7ad9d tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Returning 404 to user: Instance 84743d24-2644-46a9-86a3-030706f2ec33 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 16:04:29.218684 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c163cf27-c61c-4153-a0d8-ee5917b7ad9d tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33" status: 404 len: 111 microversion: 2.1 time: 0.031358 Sep 07 16:04:29.218684 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 428/874] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:04:29 2022] GET /compute/v2.1/servers/84743d24-2644-46a9-86a3-030706f2ec33 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 16:04:29.222644 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-716b3896-9fe6-4a7c-8e42-006d663b8511 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] Calling method '.version_select at 0x7ff9a5ace790>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:04:29.246105 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-716b3896-9fe6-4a7c-8e42-006d663b8511 tempest-TestMinimumBasicScenario-42502982 tempest-TestMinimumBasicScenario-42502982-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-215252029" status: 202 len: 0 microversion: 2.1 time: 0.027120 Sep 07 16:04:29.246670 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 447/875] 10.222.0.17 () {58 vars in 1269 bytes} [Wed Sep 7 16:04:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-215252029 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 16:04:30.119471 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-249d59e7-809b-46c1-b449-e5495a1773b1 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:04:30.120117 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-249d59e7-809b-46c1-b449-e5495a1773b1 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 8ae4d7f1-1422-4346-84ab-72682ad0a928] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:04:30.126698 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-249d59e7-809b-46c1-b449-e5495a1773b1 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:30.128067 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-249d59e7-809b-46c1-b449-e5495a1773b1 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:30.128518 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-249d59e7-809b-46c1-b449-e5495a1773b1 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:30.129228 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-249d59e7-809b-46c1-b449-e5495a1773b1 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:30.129692 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-249d59e7-809b-46c1-b449-e5495a1773b1 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:30.130123 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-249d59e7-809b-46c1-b449-e5495a1773b1 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:30.260768 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-249d59e7-809b-46c1-b449-e5495a1773b1 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:04:30.269059 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-249d59e7-809b-46c1-b449-e5495a1773b1 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928" status: 200 len: 1368 microversion: 2.1 time: 0.153315 Sep 07 16:04:30.269622 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 429/876] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:04:30 2022] GET /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:04:31.292348 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-81a11207-9c12-4848-8b89-89a546a38ebf tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:04:31.293085 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-81a11207-9c12-4848-8b89-89a546a38ebf tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 8ae4d7f1-1422-4346-84ab-72682ad0a928] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:04:31.301069 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-81a11207-9c12-4848-8b89-89a546a38ebf tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:31.301551 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-81a11207-9c12-4848-8b89-89a546a38ebf tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:31.301981 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-81a11207-9c12-4848-8b89-89a546a38ebf tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:31.302666 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-81a11207-9c12-4848-8b89-89a546a38ebf tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:31.303118 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-81a11207-9c12-4848-8b89-89a546a38ebf tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:31.303559 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-81a11207-9c12-4848-8b89-89a546a38ebf tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:31.530629 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-81a11207-9c12-4848-8b89-89a546a38ebf tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:04:31.539776 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-81a11207-9c12-4848-8b89-89a546a38ebf tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928" status: 200 len: 1368 microversion: 2.1 time: 0.251376 Sep 07 16:04:31.549129 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 448/877] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:04:31 2022] GET /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928 => generated 1368 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:04:32.562809 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-31adb072-39b0-4b5c-88f4-1d5429209a9e tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:04:32.563647 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-31adb072-39b0-4b5c-88f4-1d5429209a9e tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 8ae4d7f1-1422-4346-84ab-72682ad0a928] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:04:32.570768 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-31adb072-39b0-4b5c-88f4-1d5429209a9e tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:32.571339 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-31adb072-39b0-4b5c-88f4-1d5429209a9e tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:32.571891 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-31adb072-39b0-4b5c-88f4-1d5429209a9e tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:32.572593 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-31adb072-39b0-4b5c-88f4-1d5429209a9e tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:32.573070 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-31adb072-39b0-4b5c-88f4-1d5429209a9e tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:32.573634 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-31adb072-39b0-4b5c-88f4-1d5429209a9e tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:32.801141 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-31adb072-39b0-4b5c-88f4-1d5429209a9e tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:04:32.811992 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-31adb072-39b0-4b5c-88f4-1d5429209a9e tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928" status: 200 len: 1368 microversion: 2.1 time: 0.253178 Sep 07 16:04:32.813138 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 430/878] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:04:32 2022] GET /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928 => generated 1368 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:04:33.835183 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-975c9dda-6700-4691-a1a8-a342b245a6f8 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:04:33.835969 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-975c9dda-6700-4691-a1a8-a342b245a6f8 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 8ae4d7f1-1422-4346-84ab-72682ad0a928] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:04:33.838330 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:04:33.844328 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-975c9dda-6700-4691-a1a8-a342b245a6f8 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:33.845039 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-975c9dda-6700-4691-a1a8-a342b245a6f8 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:33.845472 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-975c9dda-6700-4691-a1a8-a342b245a6f8 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:33.846191 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-975c9dda-6700-4691-a1a8-a342b245a6f8 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:33.846637 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-975c9dda-6700-4691-a1a8-a342b245a6f8 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:33.847056 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-975c9dda-6700-4691-a1a8-a342b245a6f8 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:34.053541 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-975c9dda-6700-4691-a1a8-a342b245a6f8 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:04:34.061176 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-975c9dda-6700-4691-a1a8-a342b245a6f8 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928" status: 200 len: 1368 microversion: 2.1 time: 0.229830 Sep 07 16:04:34.061740 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 449/879] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:04:33 2022] GET /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928 => generated 1368 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:04:35.084525 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4d09f9d3-507c-42dc-87c8-5e36e0897585 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:04:35.085215 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4d09f9d3-507c-42dc-87c8-5e36e0897585 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 8ae4d7f1-1422-4346-84ab-72682ad0a928] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:04:35.093338 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:04:35.094771 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=10 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:04:35.097434 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4d09f9d3-507c-42dc-87c8-5e36e0897585 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:35.098712 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4d09f9d3-507c-42dc-87c8-5e36e0897585 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:35.099747 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4d09f9d3-507c-42dc-87c8-5e36e0897585 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:35.101551 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4d09f9d3-507c-42dc-87c8-5e36e0897585 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:35.102995 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4d09f9d3-507c-42dc-87c8-5e36e0897585 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:35.103692 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4d09f9d3-507c-42dc-87c8-5e36e0897585 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:35.171984 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-01c0f7ef-55e5-4f54-a130-bb55ece1983f req-bb768fc2-1b3f-4dcc-8899-5fea8781d266 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ae4d7f1-1422-4346-84ab-72682ad0a928", "name": "network-vif-plugged", "status": "completed", "tag": "564cc98f-00eb-466c-b68e-33eaa3b07be5"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:04:35.194564 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-01c0f7ef-55e5-4f54-a130-bb55ece1983f req-bb768fc2-1b3f-4dcc-8899-5fea8781d266 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:35.195466 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-01c0f7ef-55e5-4f54-a130-bb55ece1983f req-bb768fc2-1b3f-4dcc-8899-5fea8781d266 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:35.196193 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-01c0f7ef-55e5-4f54-a130-bb55ece1983f req-bb768fc2-1b3f-4dcc-8899-5fea8781d266 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:35.219855 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-01c0f7ef-55e5-4f54-a130-bb55ece1983f req-bb768fc2-1b3f-4dcc-8899-5fea8781d266 service nova] Creating event network-vif-plugged:564cc98f-00eb-466c-b68e-33eaa3b07be5 for instance 8ae4d7f1-1422-4346-84ab-72682ad0a928 on hv-cinder-85331 Sep 07 16:04:35.237206 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-01c0f7ef-55e5-4f54-a130-bb55ece1983f req-bb768fc2-1b3f-4dcc-8899-5fea8781d266 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069931 Sep 07 16:04:35.238299 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 450/880] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 16:04:35.271571 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-4d09f9d3-507c-42dc-87c8-5e36e0897585 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:04:35.279860 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4d09f9d3-507c-42dc-87c8-5e36e0897585 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928" status: 200 len: 1368 microversion: 2.1 time: 0.199080 Sep 07 16:04:35.280695 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 431/881] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:04:35 2022] GET /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928 => generated 1368 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:04:36.303802 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d397904b-5115-449c-9edf-275fad6e23b3 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:04:36.305141 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d397904b-5115-449c-9edf-275fad6e23b3 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 8ae4d7f1-1422-4346-84ab-72682ad0a928] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:04:36.314857 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d397904b-5115-449c-9edf-275fad6e23b3 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:36.315348 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d397904b-5115-449c-9edf-275fad6e23b3 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:36.315805 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d397904b-5115-449c-9edf-275fad6e23b3 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:36.316522 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d397904b-5115-449c-9edf-275fad6e23b3 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:36.316969 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d397904b-5115-449c-9edf-275fad6e23b3 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:36.317390 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d397904b-5115-449c-9edf-275fad6e23b3 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:36.591457 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d397904b-5115-449c-9edf-275fad6e23b3 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:04:36.607162 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d397904b-5115-449c-9edf-275fad6e23b3 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928" status: 200 len: 1368 microversion: 2.1 time: 0.307834 Sep 07 16:04:36.607850 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 451/882] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:04:36 2022] GET /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928 => generated 1368 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:04:37.630819 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5acaec47-76ca-4ee1-b6e7-2f13d7ae611d tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:04:37.631459 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5acaec47-76ca-4ee1-b6e7-2f13d7ae611d tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 8ae4d7f1-1422-4346-84ab-72682ad0a928] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:04:37.638125 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5acaec47-76ca-4ee1-b6e7-2f13d7ae611d tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:37.638614 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5acaec47-76ca-4ee1-b6e7-2f13d7ae611d tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:37.639225 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5acaec47-76ca-4ee1-b6e7-2f13d7ae611d tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:37.639947 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5acaec47-76ca-4ee1-b6e7-2f13d7ae611d tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:37.640431 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5acaec47-76ca-4ee1-b6e7-2f13d7ae611d tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:37.640877 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5acaec47-76ca-4ee1-b6e7-2f13d7ae611d tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:37.645169 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=75 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:04:37.792066 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-5acaec47-76ca-4ee1-b6e7-2f13d7ae611d tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:04:37.800349 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5acaec47-76ca-4ee1-b6e7-2f13d7ae611d tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928" status: 200 len: 1559 microversion: 2.1 time: 0.173294 Sep 07 16:04:37.800933 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 432/883] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:04:37 2022] GET /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:04:37.823944 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ce4df247-3ea3-46a7-83fe-76c6bf521efc tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:04:37.824589 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ce4df247-3ea3-46a7-83fe-76c6bf521efc tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 8ae4d7f1-1422-4346-84ab-72682ad0a928] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:04:37.831410 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce4df247-3ea3-46a7-83fe-76c6bf521efc tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:37.831930 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce4df247-3ea3-46a7-83fe-76c6bf521efc tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:37.832365 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce4df247-3ea3-46a7-83fe-76c6bf521efc tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:37.833080 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce4df247-3ea3-46a7-83fe-76c6bf521efc tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:37.833560 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce4df247-3ea3-46a7-83fe-76c6bf521efc tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:37.833976 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ce4df247-3ea3-46a7-83fe-76c6bf521efc tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:37.917622 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ce4df247-3ea3-46a7-83fe-76c6bf521efc tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097862 Sep 07 16:04:37.918310 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 452/884] 10.222.0.17 () {58 vars in 1275 bytes} [Wed Sep 7 16:04:37 2022] GET /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:04:38.824105 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-0e36e181-9e4c-4d6a-bd8d-b5a0c63ab99b req-513e5845-cd6a-4e7a-8526-8d0a51a1bb63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ae4d7f1-1422-4346-84ab-72682ad0a928", "tag": "564cc98f-00eb-466c-b68e-33eaa3b07be5"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:04:38.833717 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-0e36e181-9e4c-4d6a-bd8d-b5a0c63ab99b req-513e5845-cd6a-4e7a-8526-8d0a51a1bb63 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:38.834298 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-0e36e181-9e4c-4d6a-bd8d-b5a0c63ab99b req-513e5845-cd6a-4e7a-8526-8d0a51a1bb63 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:38.834732 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-0e36e181-9e4c-4d6a-bd8d-b5a0c63ab99b req-513e5845-cd6a-4e7a-8526-8d0a51a1bb63 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:38.846152 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-0e36e181-9e4c-4d6a-bd8d-b5a0c63ab99b req-513e5845-cd6a-4e7a-8526-8d0a51a1bb63 service nova] Creating event network-changed:564cc98f-00eb-466c-b68e-33eaa3b07be5 for instance 8ae4d7f1-1422-4346-84ab-72682ad0a928 on hv-cinder-85331 Sep 07 16:04:38.851436 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-0e36e181-9e4c-4d6a-bd8d-b5a0c63ab99b req-513e5845-cd6a-4e7a-8526-8d0a51a1bb63 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031125 Sep 07 16:04:38.852073 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 433/885] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:04:46.915833 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-903882ec-b8a2-41f0-b8de-0281c8b90c33 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:04:46.916361 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-903882ec-b8a2-41f0-b8de-0281c8b90c33 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:04:46.922831 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-903882ec-b8a2-41f0-b8de-0281c8b90c33 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:46.923307 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-903882ec-b8a2-41f0-b8de-0281c8b90c33 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:46.923775 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-903882ec-b8a2-41f0-b8de-0281c8b90c33 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:46.924452 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-903882ec-b8a2-41f0-b8de-0281c8b90c33 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:46.924897 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-903882ec-b8a2-41f0-b8de-0281c8b90c33 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:46.925317 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-903882ec-b8a2-41f0-b8de-0281c8b90c33 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:46.948163 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-903882ec-b8a2-41f0-b8de-0281c8b90c33 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f/ips" status: 200 len: 152 microversion: 2.20 time: 0.037173 Sep 07 16:04:46.948716 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 453/886] 10.222.0.17 () {60 vars in 1289 bytes} [Wed Sep 7 16:04:46 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 16:04:48.679084 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-93c49783-d1f4-429d-bb53-601704369905 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:04:48.679731 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-93c49783-d1f4-429d-bb53-601704369905 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:04:48.685936 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-93c49783-d1f4-429d-bb53-601704369905 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:48.686415 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-93c49783-d1f4-429d-bb53-601704369905 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:48.686847 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-93c49783-d1f4-429d-bb53-601704369905 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:48.687529 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-93c49783-d1f4-429d-bb53-601704369905 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:48.688072 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-93c49783-d1f4-429d-bb53-601704369905 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:48.688495 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-93c49783-d1f4-429d-bb53-601704369905 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:48.710398 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-93c49783-d1f4-429d-bb53-601704369905 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lazy-loading 'flavor' on Instance uuid 08697d07-9370-4fcc-aa5b-d10000a4746f {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 16:04:48.894259 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-93c49783-d1f4-429d-bb53-601704369905 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "POST /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f/action" status: 202 len: 0 microversion: 2.20 time: 0.219943 Sep 07 16:04:48.894848 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 434/887] 10.222.0.17 () {62 vars in 1319 bytes} [Wed Sep 7 16:04:48 2022] POST /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 16:04:48.903183 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f99d8a9e-2544-4677-9edc-cfcf233d1ccd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:04:48.903824 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f99d8a9e-2544-4677-9edc-cfcf233d1ccd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:04:48.911184 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f99d8a9e-2544-4677-9edc-cfcf233d1ccd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:48.911714 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f99d8a9e-2544-4677-9edc-cfcf233d1ccd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:48.912192 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f99d8a9e-2544-4677-9edc-cfcf233d1ccd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:48.913069 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f99d8a9e-2544-4677-9edc-cfcf233d1ccd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:48.913581 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f99d8a9e-2544-4677-9edc-cfcf233d1ccd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:48.913947 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f99d8a9e-2544-4677-9edc-cfcf233d1ccd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:49.053659 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f99d8a9e-2544-4677-9edc-cfcf233d1ccd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:04:49.061601 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f99d8a9e-2544-4677-9edc-cfcf233d1ccd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:04:49.063018 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f99d8a9e-2544-4677-9edc-cfcf233d1ccd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:04:49.064183 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f99d8a9e-2544-4677-9edc-cfcf233d1ccd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1723 microversion: 2.20 time: 0.164945 Sep 07 16:04:49.064727 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 454/888] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:04:48 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:04:50.090619 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9a977ce3-f232-4eb9-8217-9b300ad9266b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:04:50.091307 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9a977ce3-f232-4eb9-8217-9b300ad9266b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:04:50.093247 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:04:50.099977 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9a977ce3-f232-4eb9-8217-9b300ad9266b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:50.100488 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9a977ce3-f232-4eb9-8217-9b300ad9266b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:50.100925 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9a977ce3-f232-4eb9-8217-9b300ad9266b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:50.101610 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9a977ce3-f232-4eb9-8217-9b300ad9266b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:50.102066 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9a977ce3-f232-4eb9-8217-9b300ad9266b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:50.102488 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9a977ce3-f232-4eb9-8217-9b300ad9266b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:50.231504 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-9a977ce3-f232-4eb9-8217-9b300ad9266b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:04:50.239512 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-9a977ce3-f232-4eb9-8217-9b300ad9266b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:04:50.240985 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-9a977ce3-f232-4eb9-8217-9b300ad9266b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:04:50.242132 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9a977ce3-f232-4eb9-8217-9b300ad9266b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1723 microversion: 2.20 time: 0.156259 Sep 07 16:04:50.242679 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 435/889] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:04:50 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:04:51.269428 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7f01852b-d506-4e8d-b811-ef7e57119e0a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:04:51.270070 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7f01852b-d506-4e8d-b811-ef7e57119e0a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:04:51.272407 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:04:51.277764 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f01852b-d506-4e8d-b811-ef7e57119e0a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:51.278244 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f01852b-d506-4e8d-b811-ef7e57119e0a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:51.278672 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f01852b-d506-4e8d-b811-ef7e57119e0a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:51.279347 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f01852b-d506-4e8d-b811-ef7e57119e0a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:51.279818 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f01852b-d506-4e8d-b811-ef7e57119e0a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:51.280237 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7f01852b-d506-4e8d-b811-ef7e57119e0a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:51.407859 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7f01852b-d506-4e8d-b811-ef7e57119e0a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:04:51.415836 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7f01852b-d506-4e8d-b811-ef7e57119e0a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:04:51.417192 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7f01852b-d506-4e8d-b811-ef7e57119e0a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:04:51.418330 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7f01852b-d506-4e8d-b811-ef7e57119e0a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1723 microversion: 2.20 time: 0.153228 Sep 07 16:04:51.418876 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 455/890] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:04:51 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:04:52.442917 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-99542711-e98f-490d-9d6f-1ff143352be5 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:04:52.443468 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-99542711-e98f-490d-9d6f-1ff143352be5 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:04:52.449861 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99542711-e98f-490d-9d6f-1ff143352be5 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:52.450339 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99542711-e98f-490d-9d6f-1ff143352be5 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:52.450765 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99542711-e98f-490d-9d6f-1ff143352be5 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:52.451441 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99542711-e98f-490d-9d6f-1ff143352be5 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:52.451914 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99542711-e98f-490d-9d6f-1ff143352be5 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:52.452338 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99542711-e98f-490d-9d6f-1ff143352be5 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:52.577931 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-99542711-e98f-490d-9d6f-1ff143352be5 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:04:52.585819 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-99542711-e98f-490d-9d6f-1ff143352be5 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:04:52.587229 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-99542711-e98f-490d-9d6f-1ff143352be5 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:04:52.588410 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-99542711-e98f-490d-9d6f-1ff143352be5 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1723 microversion: 2.20 time: 0.149473 Sep 07 16:04:52.588952 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 436/891] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:04:52 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:04:53.614960 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ebddd0ee-fedf-4fe1-9546-94d18c3b5247 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:04:53.615576 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ebddd0ee-fedf-4fe1-9546-94d18c3b5247 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:04:53.621960 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ebddd0ee-fedf-4fe1-9546-94d18c3b5247 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:53.622456 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ebddd0ee-fedf-4fe1-9546-94d18c3b5247 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:53.622882 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ebddd0ee-fedf-4fe1-9546-94d18c3b5247 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:53.623570 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ebddd0ee-fedf-4fe1-9546-94d18c3b5247 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:53.624019 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ebddd0ee-fedf-4fe1-9546-94d18c3b5247 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:53.625011 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ebddd0ee-fedf-4fe1-9546-94d18c3b5247 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:53.627484 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:04:53.756365 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ebddd0ee-fedf-4fe1-9546-94d18c3b5247 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:04:53.764308 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ebddd0ee-fedf-4fe1-9546-94d18c3b5247 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:04:53.765855 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ebddd0ee-fedf-4fe1-9546-94d18c3b5247 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:04:53.767003 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ebddd0ee-fedf-4fe1-9546-94d18c3b5247 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1723 microversion: 2.20 time: 0.155907 Sep 07 16:04:53.767562 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 456/892] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:04:53 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:04:54.792068 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-93c26140-b363-437d-a976-cb3abb320f64 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:04:54.792677 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-93c26140-b363-437d-a976-cb3abb320f64 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:04:54.799689 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-93c26140-b363-437d-a976-cb3abb320f64 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:54.800168 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-93c26140-b363-437d-a976-cb3abb320f64 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:54.800598 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-93c26140-b363-437d-a976-cb3abb320f64 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:54.801273 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-93c26140-b363-437d-a976-cb3abb320f64 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:54.801725 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-93c26140-b363-437d-a976-cb3abb320f64 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:54.802143 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-93c26140-b363-437d-a976-cb3abb320f64 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:54.927250 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-93c26140-b363-437d-a976-cb3abb320f64 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:04:54.935174 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-93c26140-b363-437d-a976-cb3abb320f64 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:04:54.937208 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-93c26140-b363-437d-a976-cb3abb320f64 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:04:54.938360 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-93c26140-b363-437d-a976-cb3abb320f64 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1723 microversion: 2.20 time: 0.150189 Sep 07 16:04:54.938905 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 437/893] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:04:54 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:04:55.963142 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f38ec3ec-e7fd-45f1-81ec-0038a0463303 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:04:55.963765 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f38ec3ec-e7fd-45f1-81ec-0038a0463303 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:04:55.970551 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f38ec3ec-e7fd-45f1-81ec-0038a0463303 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:55.971032 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f38ec3ec-e7fd-45f1-81ec-0038a0463303 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:55.971466 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f38ec3ec-e7fd-45f1-81ec-0038a0463303 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:55.972179 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f38ec3ec-e7fd-45f1-81ec-0038a0463303 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:55.972631 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f38ec3ec-e7fd-45f1-81ec-0038a0463303 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:55.973053 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f38ec3ec-e7fd-45f1-81ec-0038a0463303 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:56.097590 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f38ec3ec-e7fd-45f1-81ec-0038a0463303 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:04:56.105708 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f38ec3ec-e7fd-45f1-81ec-0038a0463303 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:04:56.107113 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f38ec3ec-e7fd-45f1-81ec-0038a0463303 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:04:56.108318 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f38ec3ec-e7fd-45f1-81ec-0038a0463303 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1723 microversion: 2.20 time: 0.148961 Sep 07 16:04:56.108863 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 457/894] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:04:55 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:04:57.133580 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-00afdd48-b34b-4b5a-a1a6-293e4d09b682 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:04:57.134189 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-00afdd48-b34b-4b5a-a1a6-293e4d09b682 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:04:57.141502 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00afdd48-b34b-4b5a-a1a6-293e4d09b682 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:57.141990 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00afdd48-b34b-4b5a-a1a6-293e4d09b682 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:57.142432 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00afdd48-b34b-4b5a-a1a6-293e4d09b682 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:57.143192 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00afdd48-b34b-4b5a-a1a6-293e4d09b682 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:57.143680 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00afdd48-b34b-4b5a-a1a6-293e4d09b682 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:57.144175 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00afdd48-b34b-4b5a-a1a6-293e4d09b682 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:57.274260 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-00afdd48-b34b-4b5a-a1a6-293e4d09b682 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:04:57.282842 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-00afdd48-b34b-4b5a-a1a6-293e4d09b682 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:04:57.284305 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-00afdd48-b34b-4b5a-a1a6-293e4d09b682 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:04:57.285459 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-00afdd48-b34b-4b5a-a1a6-293e4d09b682 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1723 microversion: 2.20 time: 0.155777 Sep 07 16:04:57.286020 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 438/895] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:04:57 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:04:58.309784 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0f9bd942-2c07-41c5-96ba-570e5411dfae tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:04:58.310392 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0f9bd942-2c07-41c5-96ba-570e5411dfae tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:04:58.317042 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f9bd942-2c07-41c5-96ba-570e5411dfae tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:58.317526 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f9bd942-2c07-41c5-96ba-570e5411dfae tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:58.318005 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f9bd942-2c07-41c5-96ba-570e5411dfae tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:58.318707 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f9bd942-2c07-41c5-96ba-570e5411dfae tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:58.319140 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f9bd942-2c07-41c5-96ba-570e5411dfae tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:58.319580 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0f9bd942-2c07-41c5-96ba-570e5411dfae tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:58.453658 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-0f9bd942-2c07-41c5-96ba-570e5411dfae tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:04:58.461851 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-0f9bd942-2c07-41c5-96ba-570e5411dfae tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:04:58.463256 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-0f9bd942-2c07-41c5-96ba-570e5411dfae tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:04:58.464436 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0f9bd942-2c07-41c5-96ba-570e5411dfae tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1723 microversion: 2.20 time: 0.158500 Sep 07 16:04:58.464986 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 458/896] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:04:58 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:04:59.490125 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-549e1ed9-8d3f-4525-a8b5-09c36efb9e5e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:04:59.490728 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-549e1ed9-8d3f-4525-a8b5-09c36efb9e5e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:04:59.497282 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-549e1ed9-8d3f-4525-a8b5-09c36efb9e5e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:59.497761 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-549e1ed9-8d3f-4525-a8b5-09c36efb9e5e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:59.498189 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-549e1ed9-8d3f-4525-a8b5-09c36efb9e5e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:59.498864 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-549e1ed9-8d3f-4525-a8b5-09c36efb9e5e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:04:59.499309 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-549e1ed9-8d3f-4525-a8b5-09c36efb9e5e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:04:59.499752 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-549e1ed9-8d3f-4525-a8b5-09c36efb9e5e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:04:59.630218 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-549e1ed9-8d3f-4525-a8b5-09c36efb9e5e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:04:59.638282 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-549e1ed9-8d3f-4525-a8b5-09c36efb9e5e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:04:59.639719 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-549e1ed9-8d3f-4525-a8b5-09c36efb9e5e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:04:59.640869 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-549e1ed9-8d3f-4525-a8b5-09c36efb9e5e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1723 microversion: 2.20 time: 0.154618 Sep 07 16:04:59.641421 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 439/897] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:04:59 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:05:00.665979 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e8b2332d-5cf9-451e-9e7e-720a948bd37b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:00.666582 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e8b2332d-5cf9-451e-9e7e-720a948bd37b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:00.672981 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8b2332d-5cf9-451e-9e7e-720a948bd37b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:00.673460 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8b2332d-5cf9-451e-9e7e-720a948bd37b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:00.673923 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8b2332d-5cf9-451e-9e7e-720a948bd37b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:00.674603 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8b2332d-5cf9-451e-9e7e-720a948bd37b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:00.675049 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8b2332d-5cf9-451e-9e7e-720a948bd37b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:00.675469 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e8b2332d-5cf9-451e-9e7e-720a948bd37b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:00.808388 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e8b2332d-5cf9-451e-9e7e-720a948bd37b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:00.816984 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e8b2332d-5cf9-451e-9e7e-720a948bd37b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:00.818443 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e8b2332d-5cf9-451e-9e7e-720a948bd37b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:00.819624 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e8b2332d-5cf9-451e-9e7e-720a948bd37b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1744 microversion: 2.20 time: 0.157516 Sep 07 16:05:00.820176 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 459/898] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:05:00 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 16:05:01.845954 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-610a0653-7146-49b1-b8ab-d30d0efbd441 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:01.846501 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-610a0653-7146-49b1-b8ab-d30d0efbd441 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:01.853118 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-610a0653-7146-49b1-b8ab-d30d0efbd441 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:01.853600 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-610a0653-7146-49b1-b8ab-d30d0efbd441 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:01.854036 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-610a0653-7146-49b1-b8ab-d30d0efbd441 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:01.854720 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-610a0653-7146-49b1-b8ab-d30d0efbd441 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:01.855172 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-610a0653-7146-49b1-b8ab-d30d0efbd441 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:01.855618 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-610a0653-7146-49b1-b8ab-d30d0efbd441 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:01.983170 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-610a0653-7146-49b1-b8ab-d30d0efbd441 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:01.991249 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-610a0653-7146-49b1-b8ab-d30d0efbd441 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:01.992712 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-610a0653-7146-49b1-b8ab-d30d0efbd441 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:01.993884 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-610a0653-7146-49b1-b8ab-d30d0efbd441 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1744 microversion: 2.20 time: 0.153522 Sep 07 16:05:01.994434 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 440/899] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:05:01 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:05:03.019136 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fd8f8639-4b19-4ba6-bbc7-bc87c43d3fbb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:03.019797 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fd8f8639-4b19-4ba6-bbc7-bc87c43d3fbb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:03.026155 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd8f8639-4b19-4ba6-bbc7-bc87c43d3fbb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:03.026629 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd8f8639-4b19-4ba6-bbc7-bc87c43d3fbb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:03.027063 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd8f8639-4b19-4ba6-bbc7-bc87c43d3fbb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:03.027775 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd8f8639-4b19-4ba6-bbc7-bc87c43d3fbb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:03.028234 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd8f8639-4b19-4ba6-bbc7-bc87c43d3fbb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:03.028655 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fd8f8639-4b19-4ba6-bbc7-bc87c43d3fbb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:03.157218 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-fd8f8639-4b19-4ba6-bbc7-bc87c43d3fbb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:03.165663 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-fd8f8639-4b19-4ba6-bbc7-bc87c43d3fbb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:03.167396 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-fd8f8639-4b19-4ba6-bbc7-bc87c43d3fbb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:03.168672 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fd8f8639-4b19-4ba6-bbc7-bc87c43d3fbb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1744 microversion: 2.20 time: 0.153486 Sep 07 16:05:03.169340 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 460/900] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:05:03 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:05:03.279517 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-7f1caa4f-727e-4c9d-8f0a-336623572cf2 req-e427e18b-41ca-47e6-be5d-8c56d7016402 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08697d07-9370-4fcc-aa5b-d10000a4746f", "name": "network-vif-plugged", "status": "completed", "tag": "08aa359d-08f5-45a8-976a-77fc0471bfe3"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:05:03.289969 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-7f1caa4f-727e-4c9d-8f0a-336623572cf2 req-e427e18b-41ca-47e6-be5d-8c56d7016402 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:03.290448 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-7f1caa4f-727e-4c9d-8f0a-336623572cf2 req-e427e18b-41ca-47e6-be5d-8c56d7016402 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:03.290874 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-7f1caa4f-727e-4c9d-8f0a-336623572cf2 req-e427e18b-41ca-47e6-be5d-8c56d7016402 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:03.301982 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-7f1caa4f-727e-4c9d-8f0a-336623572cf2 req-e427e18b-41ca-47e6-be5d-8c56d7016402 service nova] Creating event network-vif-plugged:08aa359d-08f5-45a8-976a-77fc0471bfe3 for instance 08697d07-9370-4fcc-aa5b-d10000a4746f on hv-cinder-85331 Sep 07 16:05:03.307026 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-7f1caa4f-727e-4c9d-8f0a-336623572cf2 req-e427e18b-41ca-47e6-be5d-8c56d7016402 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031150 Sep 07 16:05:03.307735 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 441/901] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:05:04.193398 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-99d41573-58de-4396-86d8-2357fb6df45f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:04.193996 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-99d41573-58de-4396-86d8-2357fb6df45f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:04.200352 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99d41573-58de-4396-86d8-2357fb6df45f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:04.200824 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99d41573-58de-4396-86d8-2357fb6df45f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:04.201253 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99d41573-58de-4396-86d8-2357fb6df45f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:04.201929 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99d41573-58de-4396-86d8-2357fb6df45f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:04.202375 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99d41573-58de-4396-86d8-2357fb6df45f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:04.202796 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-99d41573-58de-4396-86d8-2357fb6df45f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:04.330886 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-99d41573-58de-4396-86d8-2357fb6df45f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:04.339411 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-99d41573-58de-4396-86d8-2357fb6df45f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:04.340867 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-99d41573-58de-4396-86d8-2357fb6df45f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:04.342032 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-99d41573-58de-4396-86d8-2357fb6df45f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1744 microversion: 2.20 time: 0.152511 Sep 07 16:05:04.342589 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 461/902] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:05:04 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:05:05.371132 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8efa8876-5ff5-4ded-9f1c-43d8a9120c58 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:05.371858 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8efa8876-5ff5-4ded-9f1c-43d8a9120c58 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:05.378614 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8efa8876-5ff5-4ded-9f1c-43d8a9120c58 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:05.379089 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8efa8876-5ff5-4ded-9f1c-43d8a9120c58 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:05.379524 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8efa8876-5ff5-4ded-9f1c-43d8a9120c58 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:05.380230 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8efa8876-5ff5-4ded-9f1c-43d8a9120c58 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:05.380682 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8efa8876-5ff5-4ded-9f1c-43d8a9120c58 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:05.381107 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8efa8876-5ff5-4ded-9f1c-43d8a9120c58 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:05.507643 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-8efa8876-5ff5-4ded-9f1c-43d8a9120c58 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:05.515686 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-8efa8876-5ff5-4ded-9f1c-43d8a9120c58 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:05.517103 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-8efa8876-5ff5-4ded-9f1c-43d8a9120c58 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:05.518253 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8efa8876-5ff5-4ded-9f1c-43d8a9120c58 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1744 microversion: 2.20 time: 0.151876 Sep 07 16:05:05.518852 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 442/903] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:05:05 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:05:06.542262 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-30de4960-cfd4-41f8-8c9a-80b4c2e009b1 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:06.542878 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-30de4960-cfd4-41f8-8c9a-80b4c2e009b1 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:06.549996 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30de4960-cfd4-41f8-8c9a-80b4c2e009b1 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:06.550481 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30de4960-cfd4-41f8-8c9a-80b4c2e009b1 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:06.550918 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30de4960-cfd4-41f8-8c9a-80b4c2e009b1 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:06.551666 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30de4960-cfd4-41f8-8c9a-80b4c2e009b1 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:06.552124 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30de4960-cfd4-41f8-8c9a-80b4c2e009b1 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:06.552557 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-30de4960-cfd4-41f8-8c9a-80b4c2e009b1 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:06.758131 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-30de4960-cfd4-41f8-8c9a-80b4c2e009b1 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:06.767633 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-30de4960-cfd4-41f8-8c9a-80b4c2e009b1 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:06.769060 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-30de4960-cfd4-41f8-8c9a-80b4c2e009b1 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:06.770209 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-30de4960-cfd4-41f8-8c9a-80b4c2e009b1 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1744 microversion: 2.20 time: 0.231810 Sep 07 16:05:06.770758 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 462/904] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:05:06 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1744 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:05:07.439704 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1b351da1-e218-4010-a382-7571816928ad tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:07.442354 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1b351da1-e218-4010-a382-7571816928ad tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:07.449224 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1b351da1-e218-4010-a382-7571816928ad tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:07.449985 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1b351da1-e218-4010-a382-7571816928ad tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:07.450619 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1b351da1-e218-4010-a382-7571816928ad tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:07.451328 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1b351da1-e218-4010-a382-7571816928ad tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:07.451989 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1b351da1-e218-4010-a382-7571816928ad tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:07.452422 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1b351da1-e218-4010-a382-7571816928ad tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:07.485025 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1b351da1-e218-4010-a382-7571816928ad tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049885 Sep 07 16:05:07.485598 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 443/905] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Sep 7 16:05:07 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 16:05:07.551525 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d17eac68-b90b-4238-b537-6f8984398429 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:07.552673 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d17eac68-b90b-4238-b537-6f8984398429 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:07.559086 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d17eac68-b90b-4238-b537-6f8984398429 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:07.559631 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d17eac68-b90b-4238-b537-6f8984398429 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:07.560070 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d17eac68-b90b-4238-b537-6f8984398429 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:07.560752 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d17eac68-b90b-4238-b537-6f8984398429 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:07.561226 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d17eac68-b90b-4238-b537-6f8984398429 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:07.561654 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d17eac68-b90b-4238-b537-6f8984398429 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:07.586504 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d17eac68-b90b-4238-b537-6f8984398429 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 16:05:07.660358 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d17eac68-b90b-4238-b537-6f8984398429 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 204 len: 0 microversion: 2.1 time: 0.112355 Sep 07 16:05:07.660934 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 463/906] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Sep 7 16:05:07 2022] DELETE /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 16:05:07.669342 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e25c1637-b295-48f2-a077-2d3d4c4ffa78 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:07.669897 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e25c1637-b295-48f2-a077-2d3d4c4ffa78 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:07.676495 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e25c1637-b295-48f2-a077-2d3d4c4ffa78 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:07.676971 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e25c1637-b295-48f2-a077-2d3d4c4ffa78 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:07.677400 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e25c1637-b295-48f2-a077-2d3d4c4ffa78 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:07.678075 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e25c1637-b295-48f2-a077-2d3d4c4ffa78 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:07.678522 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e25c1637-b295-48f2-a077-2d3d4c4ffa78 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:07.678941 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e25c1637-b295-48f2-a077-2d3d4c4ffa78 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:07.684271 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:05:07.797105 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e486abc9-c4b7-40d7-8132-9eb943fddb0d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:07.797929 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e486abc9-c4b7-40d7-8132-9eb943fddb0d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:07.803723 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e486abc9-c4b7-40d7-8132-9eb943fddb0d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:07.804200 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e486abc9-c4b7-40d7-8132-9eb943fddb0d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:07.804628 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e486abc9-c4b7-40d7-8132-9eb943fddb0d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:07.805303 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e486abc9-c4b7-40d7-8132-9eb943fddb0d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:07.805748 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e486abc9-c4b7-40d7-8132-9eb943fddb0d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:07.806210 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e486abc9-c4b7-40d7-8132-9eb943fddb0d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:07.814458 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-e25c1637-b295-48f2-a077-2d3d4c4ffa78 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:07.822283 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e25c1637-b295-48f2-a077-2d3d4c4ffa78 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1676 microversion: 2.1 time: 0.156991 Sep 07 16:05:07.822848 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 444/907] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:05:07 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:05:07.933899 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e486abc9-c4b7-40d7-8132-9eb943fddb0d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:07.941888 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e486abc9-c4b7-40d7-8132-9eb943fddb0d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:07.943288 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e486abc9-c4b7-40d7-8132-9eb943fddb0d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:07.944445 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e486abc9-c4b7-40d7-8132-9eb943fddb0d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1739 microversion: 2.20 time: 0.152357 Sep 07 16:05:07.944995 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 464/908] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:05:07 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1739 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 16:05:08.846553 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d2a49d77-c614-4ea1-a291-952c1180603d tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:08.847112 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d2a49d77-c614-4ea1-a291-952c1180603d tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:08.853655 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2a49d77-c614-4ea1-a291-952c1180603d tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:08.854140 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2a49d77-c614-4ea1-a291-952c1180603d tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:08.854576 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2a49d77-c614-4ea1-a291-952c1180603d tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:08.855257 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2a49d77-c614-4ea1-a291-952c1180603d tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:08.855743 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2a49d77-c614-4ea1-a291-952c1180603d tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:08.856167 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d2a49d77-c614-4ea1-a291-952c1180603d tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:08.973907 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e6f5ce53-a2c9-40b0-9f50-e8f16e2d6a2c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:08.974749 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e6f5ce53-a2c9-40b0-9f50-e8f16e2d6a2c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:08.985072 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6f5ce53-a2c9-40b0-9f50-e8f16e2d6a2c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:08.985638 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6f5ce53-a2c9-40b0-9f50-e8f16e2d6a2c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:08.986148 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6f5ce53-a2c9-40b0-9f50-e8f16e2d6a2c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:08.986852 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6f5ce53-a2c9-40b0-9f50-e8f16e2d6a2c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:08.987309 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6f5ce53-a2c9-40b0-9f50-e8f16e2d6a2c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:08.987764 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e6f5ce53-a2c9-40b0-9f50-e8f16e2d6a2c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:08.989492 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-d2a49d77-c614-4ea1-a291-952c1180603d tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:08.997891 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d2a49d77-c614-4ea1-a291-952c1180603d tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1676 microversion: 2.1 time: 0.155576 Sep 07 16:05:08.998641 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 445/909] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:05:08 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:05:09.117970 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e6f5ce53-a2c9-40b0-9f50-e8f16e2d6a2c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:09.127172 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e6f5ce53-a2c9-40b0-9f50-e8f16e2d6a2c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:09.128381 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e6f5ce53-a2c9-40b0-9f50-e8f16e2d6a2c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:09.129541 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e6f5ce53-a2c9-40b0-9f50-e8f16e2d6a2c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1739 microversion: 2.20 time: 0.163440 Sep 07 16:05:09.130094 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 465/910] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:05:08 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1739 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 16:05:10.021925 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0f6ab816-1b4e-45f7-be33-ceaa1c3abeeb tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:10.022536 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0f6ab816-1b4e-45f7-be33-ceaa1c3abeeb tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:10.029618 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0f6ab816-1b4e-45f7-be33-ceaa1c3abeeb tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:10.030019 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0f6ab816-1b4e-45f7-be33-ceaa1c3abeeb tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:10.030677 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0f6ab816-1b4e-45f7-be33-ceaa1c3abeeb tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:10.031413 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0f6ab816-1b4e-45f7-be33-ceaa1c3abeeb tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:10.032098 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0f6ab816-1b4e-45f7-be33-ceaa1c3abeeb tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:10.032697 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0f6ab816-1b4e-45f7-be33-ceaa1c3abeeb tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:10.106446 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-0f6ab816-1b4e-45f7-be33-ceaa1c3abeeb tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:10.117214 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0f6ab816-1b4e-45f7-be33-ceaa1c3abeeb tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 200 len: 1608 microversion: 2.1 time: 0.099082 Sep 07 16:05:10.118474 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 446/911] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:05:10 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 1608 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:05:10.156202 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-16bdbedc-4232-40de-a292-0b98fa1fcaa7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:10.157524 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-16bdbedc-4232-40de-a292-0b98fa1fcaa7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:10.168017 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-16bdbedc-4232-40de-a292-0b98fa1fcaa7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:10.168539 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-16bdbedc-4232-40de-a292-0b98fa1fcaa7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:10.168977 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-16bdbedc-4232-40de-a292-0b98fa1fcaa7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:10.175800 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-16bdbedc-4232-40de-a292-0b98fa1fcaa7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:10.176323 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-16bdbedc-4232-40de-a292-0b98fa1fcaa7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:10.176771 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-16bdbedc-4232-40de-a292-0b98fa1fcaa7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:10.237631 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-12b2014e-2504-43f8-8695-fa789ca36f39 req-379646a8-5944-4cdb-b2a3-e4d6485b6202 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9f7188c-7dad-469c-b915-511d7f6f7a14", "name": "network-vif-deleted", "tag": "e8ba6d47-0763-4132-b207-05e0e03c1ad9"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:05:10.260312 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-12b2014e-2504-43f8-8695-fa789ca36f39 req-379646a8-5944-4cdb-b2a3-e4d6485b6202 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:10.261055 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-12b2014e-2504-43f8-8695-fa789ca36f39 req-379646a8-5944-4cdb-b2a3-e4d6485b6202 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:10.261595 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-12b2014e-2504-43f8-8695-fa789ca36f39 req-379646a8-5944-4cdb-b2a3-e4d6485b6202 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:10.302288 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-12b2014e-2504-43f8-8695-fa789ca36f39 req-379646a8-5944-4cdb-b2a3-e4d6485b6202 service nova] Creating event network-vif-deleted:e8ba6d47-0763-4132-b207-05e0e03c1ad9 for instance d9f7188c-7dad-469c-b915-511d7f6f7a14 on hv-cinder-85331 Sep 07 16:05:10.321148 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-12b2014e-2504-43f8-8695-fa789ca36f39 req-379646a8-5944-4cdb-b2a3-e4d6485b6202 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093751 Sep 07 16:05:10.326711 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 447/912] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 16:05:10.452353 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-16bdbedc-4232-40de-a292-0b98fa1fcaa7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:10.461717 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-16bdbedc-4232-40de-a292-0b98fa1fcaa7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:10.464566 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-16bdbedc-4232-40de-a292-0b98fa1fcaa7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:10.467622 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-16bdbedc-4232-40de-a292-0b98fa1fcaa7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1739 microversion: 2.20 time: 0.316852 Sep 07 16:05:10.470232 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 466/913] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:05:10 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1739 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:05:11.146698 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1ce65c9a-287c-48d3-bd34-34e9ae8ac953 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:11.147446 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1ce65c9a-287c-48d3-bd34-34e9ae8ac953 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:11.158555 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1ce65c9a-287c-48d3-bd34-34e9ae8ac953 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:11.159321 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1ce65c9a-287c-48d3-bd34-34e9ae8ac953 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:11.159974 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1ce65c9a-287c-48d3-bd34-34e9ae8ac953 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:11.160669 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1ce65c9a-287c-48d3-bd34-34e9ae8ac953 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:11.161124 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1ce65c9a-287c-48d3-bd34-34e9ae8ac953 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:11.161535 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1ce65c9a-287c-48d3-bd34-34e9ae8ac953 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:11.185947 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-1ce65c9a-287c-48d3-bd34-34e9ae8ac953 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] HTTP exception thrown: Instance d9f7188c-7dad-469c-b915-511d7f6f7a14 could not be found. Sep 07 16:05:11.188195 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1ce65c9a-287c-48d3-bd34-34e9ae8ac953 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Request method failure captured: Sep 07 16:05:11.188195 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 HTTP/1.1 Sep 07 16:05:11.188195 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Accept: application/json Sep 07 16:05:11.188195 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Accept-Encoding: identity Sep 07 16:05:11.188195 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Connection: close Sep 07 16:05:11.188195 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Content-Length: 0 Sep 07 16:05:11.188195 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Content-Type: application/json Sep 07 16:05:11.188195 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Host: 10.222.0.17 Sep 07 16:05:11.188195 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Openstack-System-Scope: None Sep 07 16:05:11.188195 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Sep 07 16:05:11.188195 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjGL-dAAjtQX0BBXg33LYFvaSUKZB2bRbxMUhHSHg00Fvmow_9lu17BLkz1nJJgHoEEvSo9hsLiYfdxAGFpdgpu_DK1O22QaIqj2pcyAjUKkETT2aPl97blUlEndVWe7u0yPav2HWLaLZ_Ls49JGwXa24vQHSKAQ5iMrT_eJl8dfvq_Ps Sep 07 16:05:11.188195 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Domain-Id: None Sep 07 16:05:11.188195 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Domain-Name: None Sep 07 16:05:11.188195 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Identity-Status: Confirmed Sep 07 16:05:11.188195 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Is-Admin-Project: True Sep 07 16:05:11.188195 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Domain-Id: default Sep 07 16:05:11.188195 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Domain-Name: Default Sep 07 16:05:11.188195 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Id: a446dbd47db84c4987a3ee5332356b84 Sep 07 16:05:11.188195 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Name: tempest-AttachVolumeTestJSON-1368644544 Sep 07 16:05:11.188195 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Role: reader,member Sep 07 16:05:11.188195 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Roles: reader,member Sep 07 16:05:11.189906 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a446dbd47db84c4987a3ee5332356b84", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a446dbd47db84c4987a3ee5332356b84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a446dbd47db84c4987a3ee5332356b84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a446dbd47db84c4987a3ee5332356b84"}]}] Sep 07 16:05:11.189906 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant: tempest-AttachVolumeTestJSON-1368644544 Sep 07 16:05:11.189906 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant-Id: a446dbd47db84c4987a3ee5332356b84 Sep 07 16:05:11.189906 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1368644544 Sep 07 16:05:11.189906 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User: tempest-AttachVolumeTestJSON-1368644544-project Sep 07 16:05:11.189906 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Domain-Id: default Sep 07 16:05:11.189906 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Domain-Name: Default Sep 07 16:05:11.189906 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Id: 2fcfbaf5bab14a4783ca912a222341c0 Sep 07 16:05:11.189906 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Name: tempest-AttachVolumeTestJSON-1368644544-project Sep 07 16:05:11.189906 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: method: > Sep 07 16:05:11.189906 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: exception: Instance d9f7188c-7dad-469c-b915-511d7f6f7a14 could not be found. Sep 07 16:05:11.189906 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: action_args: {'id': 'd9f7188c-7dad-469c-b915-511d7f6f7a14'} Sep 07 16:05:11.191570 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 16:05:11.191570 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:05:11.191570 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 16:05:11.191570 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 16:05:11.191570 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 16:05:11.191570 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 16:05:11.191570 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 16:05:11.191570 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 16:05:11.191570 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 16:05:11.191570 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 16:05:11.191570 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9f7188c-7dad-469c-b915-511d7f6f7a14 could not be found. Sep 07 16:05:11.191570 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:05:11.191570 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:05:11.191570 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:05:11.191570 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:05:11.191570 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:05:11.191570 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:05:11.191570 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 16:05:11.191570 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 16:05:11.191570 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 16:05:11.193226 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 16:05:11.193226 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 16:05:11.193226 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 16:05:11.193226 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 16:05:11.193226 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 16:05:11.193226 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 16:05:11.193226 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 16:05:11.193226 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9f7188c-7dad-469c-b915-511d7f6f7a14 could not be found. Sep 07 16:05:11.193226 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:05:11.193226 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:05:11.193226 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:05:11.193226 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:05:11.193226 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:05:11.193226 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:05:11.193226 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 16:05:11.193226 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 16:05:11.193226 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9f7188c-7dad-469c-b915-511d7f6f7a14 could not be found. Sep 07 16:05:11.193226 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:05:11.195532 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1ce65c9a-287c-48d3-bd34-34e9ae8ac953 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Returning 404 to user: Instance d9f7188c-7dad-469c-b915-511d7f6f7a14 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 16:05:11.195532 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1ce65c9a-287c-48d3-bd34-34e9ae8ac953 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 404 len: 111 microversion: 2.1 time: 0.052264 Sep 07 16:05:11.195532 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 448/914] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:05:11 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 16:05:11.203399 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bce75baf-2911-404e-87c0-a0e94ad4603d tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '.version_select at 0x7ff9a949cf70>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:11.224347 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bce75baf-2911-404e-87c0-a0e94ad4603d tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1756071938" status: 202 len: 0 microversion: 2.1 time: 0.028314 Sep 07 16:05:11.225272 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 467/915] 10.222.0.17 () {58 vars in 1221 bytes} [Wed Sep 7 16:05:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1756071938 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 16:05:11.510549 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a0b4c739-808f-49c8-a9ce-8c703eb2cbac tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:11.511739 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a0b4c739-808f-49c8-a9ce-8c703eb2cbac tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:11.521949 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a0b4c739-808f-49c8-a9ce-8c703eb2cbac tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:11.522726 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a0b4c739-808f-49c8-a9ce-8c703eb2cbac tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:11.523364 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a0b4c739-808f-49c8-a9ce-8c703eb2cbac tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:11.526438 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a0b4c739-808f-49c8-a9ce-8c703eb2cbac tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:11.527218 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a0b4c739-808f-49c8-a9ce-8c703eb2cbac tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:11.527870 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a0b4c739-808f-49c8-a9ce-8c703eb2cbac tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:11.806949 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-a0b4c739-808f-49c8-a9ce-8c703eb2cbac tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:11.816452 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-a0b4c739-808f-49c8-a9ce-8c703eb2cbac tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:11.817892 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-a0b4c739-808f-49c8-a9ce-8c703eb2cbac tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:11.819147 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a0b4c739-808f-49c8-a9ce-8c703eb2cbac tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1739 microversion: 2.20 time: 0.324246 Sep 07 16:05:11.820027 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 449/916] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:05:11 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1739 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:05:12.053468 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d57bedb7-8ec0-41b2-ba77-5bc622122317 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Action: 'create', calling method: .version_select at 0x7ff9a94d5310>, body: {"keypair": {"name": "tempest-keypair-1143841063", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJkJTlVP8ya3LgT7Fck/p8OZBVmt/u8yB4qHYb1mO6eCDknNlWjkNYGj5Zc45np+XYgQAtSBIujJ7eiH8iMdpQmn3zasolXoZGQhRwHAT/x987pNO0d7P+9kQPTocXI7jw=="}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:05:12.071376 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-d57bedb7-8ec0-41b2-ba77-5bc622122317 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Getting quotas for project a446dbd47db84c4987a3ee5332356b84. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 16:05:12.075585 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-d57bedb7-8ec0-41b2-ba77-5bc622122317 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Getting quotas for user 2fcfbaf5bab14a4783ca912a222341c0 and project a446dbd47db84c4987a3ee5332356b84. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 16:05:12.100421 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d57bedb7-8ec0-41b2-ba77-5bc622122317 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050778 Sep 07 16:05:12.101118 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 468/917] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Sep 7 16:05:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:05:12.847323 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dbbd9dac-c388-489a-a1f6-bb8e68c6820f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:12.848937 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-dbbd9dac-c388-489a-a1f6-bb8e68c6820f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:12.864606 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dbbd9dac-c388-489a-a1f6-bb8e68c6820f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:12.865128 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dbbd9dac-c388-489a-a1f6-bb8e68c6820f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:12.867829 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dbbd9dac-c388-489a-a1f6-bb8e68c6820f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:12.869148 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dbbd9dac-c388-489a-a1f6-bb8e68c6820f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:12.872183 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dbbd9dac-c388-489a-a1f6-bb8e68c6820f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:12.872641 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dbbd9dac-c388-489a-a1f6-bb8e68c6820f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:13.107678 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-dbbd9dac-c388-489a-a1f6-bb8e68c6820f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:13.119880 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-dbbd9dac-c388-489a-a1f6-bb8e68c6820f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:13.121743 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-dbbd9dac-c388-489a-a1f6-bb8e68c6820f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:13.122957 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-dbbd9dac-c388-489a-a1f6-bb8e68c6820f tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1739 microversion: 2.20 time: 0.281239 Sep 07 16:05:13.123499 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 450/918] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:05:12 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1739 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:05:13.618095 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-eb328205-141c-4a94-82e0-b0f8f23a6f04 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2116713207", "imageRef": "cfe19284-9779-46f4-b458-81d5475ec82f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0ef9703b-8e10-4c6e-afbd-fe54751cee86"}], "security_groups": [{"name": "tempest-securitygroup--82898806"}], "key_name": "tempest-keypair-1143841063", "user_data": "}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:05:13.737733 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-eb328205-141c-4a94-82e0-b0f8f23a6f04 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] validate_networks() for [('0ef9703b-8e10-4c6e-afbd-fe54751cee86', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 16:05:14.150808 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f649031f-b4e8-444c-a912-30244e33a4bc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:14.151358 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f649031f-b4e8-444c-a912-30244e33a4bc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:14.158408 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f649031f-b4e8-444c-a912-30244e33a4bc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:14.159188 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f649031f-b4e8-444c-a912-30244e33a4bc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:14.161157 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f649031f-b4e8-444c-a912-30244e33a4bc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:14.162097 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f649031f-b4e8-444c-a912-30244e33a4bc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:14.162757 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f649031f-b4e8-444c-a912-30244e33a4bc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:14.163355 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f649031f-b4e8-444c-a912-30244e33a4bc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:14.340244 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-f649031f-b4e8-444c-a912-30244e33a4bc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:14.350376 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-f649031f-b4e8-444c-a912-30244e33a4bc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:14.352428 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-f649031f-b4e8-444c-a912-30244e33a4bc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:14.354096 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f649031f-b4e8-444c-a912-30244e33a4bc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1739 microversion: 2.20 time: 0.207430 Sep 07 16:05:14.355328 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 451/919] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:05:14 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1739 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:05:14.453156 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-eb328205-141c-4a94-82e0-b0f8f23a6f04 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 16:05:14.453789 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-eb328205-141c-4a94-82e0-b0f8f23a6f04 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 16:05:14.454253 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-eb328205-141c-4a94-82e0-b0f8f23a6f04 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 16:05:14.454841 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-eb328205-141c-4a94-82e0-b0f8f23a6f04 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 16:05:14.455435 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-eb328205-141c-4a94-82e0-b0f8f23a6f04 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 16:05:14.464775 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb328205-141c-4a94-82e0-b0f8f23a6f04 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:14.465171 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb328205-141c-4a94-82e0-b0f8f23a6f04 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:14.465798 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb328205-141c-4a94-82e0-b0f8f23a6f04 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:14.466679 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb328205-141c-4a94-82e0-b0f8f23a6f04 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:14.467298 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb328205-141c-4a94-82e0-b0f8f23a6f04 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:14.467900 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-eb328205-141c-4a94-82e0-b0f8f23a6f04 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:14.487084 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-eb328205-141c-4a94-82e0-b0f8f23a6f04 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Getting quotas for project a446dbd47db84c4987a3ee5332356b84. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 16:05:14.491156 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-eb328205-141c-4a94-82e0-b0f8f23a6f04 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Getting quotas for user 2fcfbaf5bab14a4783ca912a222341c0 and project a446dbd47db84c4987a3ee5332356b84. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 16:05:14.502945 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-eb328205-141c-4a94-82e0-b0f8f23a6f04 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 16:05:14.505256 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-eb328205-141c-4a94-82e0-b0f8f23a6f04 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: dc89b872-7af6-430f-ab73-119715d4cbac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cfe19284-9779-46f4-b458-81d5475ec82f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 16:05:14.555567 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-eb328205-141c-4a94-82e0-b0f8f23a6f04 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.941621 Sep 07 16:05:14.556588 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 469/920] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Sep 7 16:05:13 2022] POST /compute/v2.1/servers => generated 400 bytes in 943 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 16:05:14.567990 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-65475504-0782-4433-bb6a-c38f03a7ecce tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:14.568601 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-65475504-0782-4433-bb6a-c38f03a7ecce tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: dc89b872-7af6-430f-ab73-119715d4cbac] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:14.663429 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-65475504-0782-4433-bb6a-c38f03a7ecce tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:14.671356 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-65475504-0782-4433-bb6a-c38f03a7ecce tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac" status: 200 len: 1238 microversion: 2.1 time: 0.107035 Sep 07 16:05:14.675078 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 452/921] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:05:14 2022] GET /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac => generated 1238 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:05:15.380087 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ae7a9784-d9e5-4bdb-89f9-6e0ed4cfc1ab tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:15.380675 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ae7a9784-d9e5-4bdb-89f9-6e0ed4cfc1ab tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:15.388471 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae7a9784-d9e5-4bdb-89f9-6e0ed4cfc1ab tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:15.397016 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae7a9784-d9e5-4bdb-89f9-6e0ed4cfc1ab tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:15.397467 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae7a9784-d9e5-4bdb-89f9-6e0ed4cfc1ab tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:15.398202 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae7a9784-d9e5-4bdb-89f9-6e0ed4cfc1ab tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:15.398865 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae7a9784-d9e5-4bdb-89f9-6e0ed4cfc1ab tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:15.399290 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae7a9784-d9e5-4bdb-89f9-6e0ed4cfc1ab tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:15.576812 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ae7a9784-d9e5-4bdb-89f9-6e0ed4cfc1ab tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:15.589863 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ae7a9784-d9e5-4bdb-89f9-6e0ed4cfc1ab tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:15.591807 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ae7a9784-d9e5-4bdb-89f9-6e0ed4cfc1ab tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:15.594629 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ae7a9784-d9e5-4bdb-89f9-6e0ed4cfc1ab tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1739 microversion: 2.20 time: 0.218103 Sep 07 16:05:15.596249 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 470/922] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:05:15 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1739 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:05:15.702275 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f7033563-1868-460f-83ac-c53d7cfbc4eb tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:15.702954 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f7033563-1868-460f-83ac-c53d7cfbc4eb tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: dc89b872-7af6-430f-ab73-119715d4cbac] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:15.710476 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f7033563-1868-460f-83ac-c53d7cfbc4eb tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:15.711209 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f7033563-1868-460f-83ac-c53d7cfbc4eb tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:15.711844 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f7033563-1868-460f-83ac-c53d7cfbc4eb tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:15.712738 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f7033563-1868-460f-83ac-c53d7cfbc4eb tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:15.713222 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f7033563-1868-460f-83ac-c53d7cfbc4eb tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:15.713680 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f7033563-1868-460f-83ac-c53d7cfbc4eb tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:15.776389 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-f7033563-1868-460f-83ac-c53d7cfbc4eb tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:15.784416 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f7033563-1868-460f-83ac-c53d7cfbc4eb tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac" status: 200 len: 1290 microversion: 2.1 time: 0.085983 Sep 07 16:05:15.785568 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 453/923] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:05:15 2022] GET /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac => generated 1290 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:05:16.622374 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c6464473-cabb-4278-b2e6-90c90d060665 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:16.623753 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c6464473-cabb-4278-b2e6-90c90d060665 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:16.632257 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6464473-cabb-4278-b2e6-90c90d060665 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:16.632669 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6464473-cabb-4278-b2e6-90c90d060665 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:16.633098 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6464473-cabb-4278-b2e6-90c90d060665 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:16.634015 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6464473-cabb-4278-b2e6-90c90d060665 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:16.634462 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6464473-cabb-4278-b2e6-90c90d060665 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:16.635043 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6464473-cabb-4278-b2e6-90c90d060665 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:16.810757 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8201d6a4-282e-416b-938f-cccfba5ca107 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:16.811376 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8201d6a4-282e-416b-938f-cccfba5ca107 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: dc89b872-7af6-430f-ab73-119715d4cbac] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:16.818449 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8201d6a4-282e-416b-938f-cccfba5ca107 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:16.818943 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8201d6a4-282e-416b-938f-cccfba5ca107 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:16.819377 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8201d6a4-282e-416b-938f-cccfba5ca107 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:16.822018 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8201d6a4-282e-416b-938f-cccfba5ca107 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:16.822489 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8201d6a4-282e-416b-938f-cccfba5ca107 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:16.822914 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8201d6a4-282e-416b-938f-cccfba5ca107 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:16.924656 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c6464473-cabb-4278-b2e6-90c90d060665 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:16.932978 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c6464473-cabb-4278-b2e6-90c90d060665 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:16.934721 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c6464473-cabb-4278-b2e6-90c90d060665 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:16.935623 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c6464473-cabb-4278-b2e6-90c90d060665 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1739 microversion: 2.20 time: 0.317835 Sep 07 16:05:16.936172 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 471/924] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:05:16 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1739 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:05:17.012478 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-8201d6a4-282e-416b-938f-cccfba5ca107 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:17.023108 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8201d6a4-282e-416b-938f-cccfba5ca107 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac" status: 200 len: 1362 microversion: 2.1 time: 0.216983 Sep 07 16:05:17.034479 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 454/925] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:05:16 2022] GET /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac => generated 1362 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 16:05:17.802878 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-8a2accff-9baa-49ee-b07d-1bf09c2ef7c1 req-0a02fa1d-a81b-4561-a3fb-33e194955cd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc89b872-7af6-430f-ab73-119715d4cbac", "tag": "4f0e45df-784a-4abe-9908-b3f4ca882014"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:05:17.823291 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-8a2accff-9baa-49ee-b07d-1bf09c2ef7c1 req-0a02fa1d-a81b-4561-a3fb-33e194955cd4 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:17.824030 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-8a2accff-9baa-49ee-b07d-1bf09c2ef7c1 req-0a02fa1d-a81b-4561-a3fb-33e194955cd4 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:17.824641 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-8a2accff-9baa-49ee-b07d-1bf09c2ef7c1 req-0a02fa1d-a81b-4561-a3fb-33e194955cd4 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:17.837878 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-8a2accff-9baa-49ee-b07d-1bf09c2ef7c1 req-0a02fa1d-a81b-4561-a3fb-33e194955cd4 service nova] Creating event network-changed:4f0e45df-784a-4abe-9908-b3f4ca882014 for instance dc89b872-7af6-430f-ab73-119715d4cbac on hv-cinder-85331 Sep 07 16:05:17.843884 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-8a2accff-9baa-49ee-b07d-1bf09c2ef7c1 req-0a02fa1d-a81b-4561-a3fb-33e194955cd4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044637 Sep 07 16:05:17.844829 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 472/926] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:05:17.966015 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6912c222-e3c7-4972-a595-f4a34f580610 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:17.972077 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6912c222-e3c7-4972-a595-f4a34f580610 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:17.979360 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6912c222-e3c7-4972-a595-f4a34f580610 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:17.979935 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6912c222-e3c7-4972-a595-f4a34f580610 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:17.980602 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6912c222-e3c7-4972-a595-f4a34f580610 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:17.981627 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6912c222-e3c7-4972-a595-f4a34f580610 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:17.982407 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6912c222-e3c7-4972-a595-f4a34f580610 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:17.982940 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6912c222-e3c7-4972-a595-f4a34f580610 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:18.048573 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-057e440d-3303-477f-bf24-17e5f35be491 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:18.049724 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-057e440d-3303-477f-bf24-17e5f35be491 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: dc89b872-7af6-430f-ab73-119715d4cbac] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:18.056797 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-057e440d-3303-477f-bf24-17e5f35be491 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:18.057727 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-057e440d-3303-477f-bf24-17e5f35be491 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:18.058513 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-057e440d-3303-477f-bf24-17e5f35be491 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:18.059478 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-057e440d-3303-477f-bf24-17e5f35be491 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:18.060180 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-057e440d-3303-477f-bf24-17e5f35be491 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:18.060824 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-057e440d-3303-477f-bf24-17e5f35be491 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:18.148467 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-6912c222-e3c7-4972-a595-f4a34f580610 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:18.157690 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-6912c222-e3c7-4972-a595-f4a34f580610 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:18.160304 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-6912c222-e3c7-4972-a595-f4a34f580610 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:18.161508 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6912c222-e3c7-4972-a595-f4a34f580610 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1739 microversion: 2.20 time: 0.200236 Sep 07 16:05:18.162551 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 455/927] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:05:17 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1739 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:05:18.284429 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-057e440d-3303-477f-bf24-17e5f35be491 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:18.293235 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-057e440d-3303-477f-bf24-17e5f35be491 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac" status: 200 len: 1362 microversion: 2.1 time: 0.249298 Sep 07 16:05:18.294160 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 473/928] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:05:18 2022] GET /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac => generated 1362 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:05:19.192509 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-09f2ac66-d79d-4d39-8bcc-46d2b5aacdca tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:19.193777 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-09f2ac66-d79d-4d39-8bcc-46d2b5aacdca tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:19.200313 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-09f2ac66-d79d-4d39-8bcc-46d2b5aacdca tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:19.200800 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-09f2ac66-d79d-4d39-8bcc-46d2b5aacdca tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:19.201240 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-09f2ac66-d79d-4d39-8bcc-46d2b5aacdca tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:19.201940 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-09f2ac66-d79d-4d39-8bcc-46d2b5aacdca tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:19.202434 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-09f2ac66-d79d-4d39-8bcc-46d2b5aacdca tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:19.202902 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-09f2ac66-d79d-4d39-8bcc-46d2b5aacdca tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:19.318989 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9c77d701-ab07-4f8b-9c66-2138e36c6873 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:19.320388 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-9c77d701-ab07-4f8b-9c66-2138e36c6873 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: dc89b872-7af6-430f-ab73-119715d4cbac] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:19.327694 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c77d701-ab07-4f8b-9c66-2138e36c6873 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:19.328502 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c77d701-ab07-4f8b-9c66-2138e36c6873 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:19.329511 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c77d701-ab07-4f8b-9c66-2138e36c6873 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:19.330547 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c77d701-ab07-4f8b-9c66-2138e36c6873 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:19.331233 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c77d701-ab07-4f8b-9c66-2138e36c6873 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:19.331910 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-9c77d701-ab07-4f8b-9c66-2138e36c6873 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:19.370396 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:05:19.375325 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-09f2ac66-d79d-4d39-8bcc-46d2b5aacdca tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:19.396873 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-09f2ac66-d79d-4d39-8bcc-46d2b5aacdca tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:19.398318 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-09f2ac66-d79d-4d39-8bcc-46d2b5aacdca tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:19.399524 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-09f2ac66-d79d-4d39-8bcc-46d2b5aacdca tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1739 microversion: 2.20 time: 0.214849 Sep 07 16:05:19.400096 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 456/929] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:05:19 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1739 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:05:19.522079 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-9c77d701-ab07-4f8b-9c66-2138e36c6873 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:19.531232 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9c77d701-ab07-4f8b-9c66-2138e36c6873 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac" status: 200 len: 1362 microversion: 2.1 time: 0.216684 Sep 07 16:05:19.547170 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 474/930] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:05:19 2022] GET /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac => generated 1362 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 16:05:20.439067 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-81a5748a-ac09-46ee-81db-d1a853a23dac tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:20.440377 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-81a5748a-ac09-46ee-81db-d1a853a23dac tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:20.444249 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=46 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:05:20.454821 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-81a5748a-ac09-46ee-81db-d1a853a23dac tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:20.455659 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-81a5748a-ac09-46ee-81db-d1a853a23dac tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:20.456336 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-81a5748a-ac09-46ee-81db-d1a853a23dac tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:20.457256 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-81a5748a-ac09-46ee-81db-d1a853a23dac tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:20.457895 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-81a5748a-ac09-46ee-81db-d1a853a23dac tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:20.458640 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-81a5748a-ac09-46ee-81db-d1a853a23dac tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:20.554546 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ae428858-7ddd-406c-a903-93749091a30d tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:20.555734 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ae428858-7ddd-406c-a903-93749091a30d tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: dc89b872-7af6-430f-ab73-119715d4cbac] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:20.563309 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae428858-7ddd-406c-a903-93749091a30d tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:20.563820 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae428858-7ddd-406c-a903-93749091a30d tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:20.564395 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae428858-7ddd-406c-a903-93749091a30d tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:20.565097 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae428858-7ddd-406c-a903-93749091a30d tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:20.565541 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae428858-7ddd-406c-a903-93749091a30d tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:20.565959 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ae428858-7ddd-406c-a903-93749091a30d tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:20.599619 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-81a5748a-ac09-46ee-81db-d1a853a23dac tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:20.607873 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-81a5748a-ac09-46ee-81db-d1a853a23dac tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:20.609837 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-81a5748a-ac09-46ee-81db-d1a853a23dac tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:20.611024 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-81a5748a-ac09-46ee-81db-d1a853a23dac tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1739 microversion: 2.20 time: 0.176510 Sep 07 16:05:20.611809 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 457/931] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:05:20 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1739 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:05:20.739953 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ae428858-7ddd-406c-a903-93749091a30d tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:20.747724 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ae428858-7ddd-406c-a903-93749091a30d tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac" status: 200 len: 1362 microversion: 2.1 time: 0.197206 Sep 07 16:05:20.748356 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 475/932] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:05:20 2022] GET /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac => generated 1362 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:05:21.636642 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-aa24bf47-281e-4d21-9434-d5c88a4e114d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:21.637173 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-aa24bf47-281e-4d21-9434-d5c88a4e114d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:21.644254 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aa24bf47-281e-4d21-9434-d5c88a4e114d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:21.644729 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aa24bf47-281e-4d21-9434-d5c88a4e114d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:21.645156 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aa24bf47-281e-4d21-9434-d5c88a4e114d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:21.645835 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aa24bf47-281e-4d21-9434-d5c88a4e114d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:21.646285 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aa24bf47-281e-4d21-9434-d5c88a4e114d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:21.646701 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-aa24bf47-281e-4d21-9434-d5c88a4e114d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:21.770772 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f01cf287-eed4-4efa-b3b1-b4444d020986 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:21.771426 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f01cf287-eed4-4efa-b3b1-b4444d020986 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: dc89b872-7af6-430f-ab73-119715d4cbac] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:21.773733 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:05:21.777841 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-aa24bf47-281e-4d21-9434-d5c88a4e114d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:21.780011 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f01cf287-eed4-4efa-b3b1-b4444d020986 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:21.780496 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f01cf287-eed4-4efa-b3b1-b4444d020986 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:21.781021 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f01cf287-eed4-4efa-b3b1-b4444d020986 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:21.781721 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f01cf287-eed4-4efa-b3b1-b4444d020986 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:21.782166 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f01cf287-eed4-4efa-b3b1-b4444d020986 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:21.782587 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f01cf287-eed4-4efa-b3b1-b4444d020986 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:21.786436 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-aa24bf47-281e-4d21-9434-d5c88a4e114d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:21.787848 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-aa24bf47-281e-4d21-9434-d5c88a4e114d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:21.789010 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-aa24bf47-281e-4d21-9434-d5c88a4e114d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1739 microversion: 2.20 time: 0.156304 Sep 07 16:05:21.789578 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 458/933] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:05:21 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1739 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:05:21.934152 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f01cf287-eed4-4efa-b3b1-b4444d020986 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:21.942361 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f01cf287-eed4-4efa-b3b1-b4444d020986 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac" status: 200 len: 1362 microversion: 2.1 time: 0.175425 Sep 07 16:05:21.943002 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 476/934] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:05:21 2022] GET /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 16:05:22.813802 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1780e633-4c45-44a6-acb0-3846536dfcdc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:22.814441 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1780e633-4c45-44a6-acb0-3846536dfcdc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:22.820924 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1780e633-4c45-44a6-acb0-3846536dfcdc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:22.821407 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1780e633-4c45-44a6-acb0-3846536dfcdc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:22.821838 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1780e633-4c45-44a6-acb0-3846536dfcdc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:22.822521 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1780e633-4c45-44a6-acb0-3846536dfcdc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:22.822976 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1780e633-4c45-44a6-acb0-3846536dfcdc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:22.823398 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1780e633-4c45-44a6-acb0-3846536dfcdc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:22.953345 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-1780e633-4c45-44a6-acb0-3846536dfcdc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:22.962404 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-1780e633-4c45-44a6-acb0-3846536dfcdc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:22.963927 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-1780e633-4c45-44a6-acb0-3846536dfcdc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:22.965097 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1780e633-4c45-44a6-acb0-3846536dfcdc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1721 microversion: 2.20 time: 0.155267 Sep 07 16:05:22.965211 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-940142c1-c9ef-47a3-b0b8-dd34de33860c tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:22.965651 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 459/935] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:05:22 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:05:22.965747 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-940142c1-c9ef-47a3-b0b8-dd34de33860c tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: dc89b872-7af6-430f-ab73-119715d4cbac] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:22.972559 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-940142c1-c9ef-47a3-b0b8-dd34de33860c tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:22.973303 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-940142c1-c9ef-47a3-b0b8-dd34de33860c tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:22.973735 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-940142c1-c9ef-47a3-b0b8-dd34de33860c tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:22.974420 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-940142c1-c9ef-47a3-b0b8-dd34de33860c tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:22.974866 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-940142c1-c9ef-47a3-b0b8-dd34de33860c tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:22.975283 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-940142c1-c9ef-47a3-b0b8-dd34de33860c tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:23.102821 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-940142c1-c9ef-47a3-b0b8-dd34de33860c tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:23.110427 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-940142c1-c9ef-47a3-b0b8-dd34de33860c tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac" status: 200 len: 1362 microversion: 2.1 time: 0.149350 Sep 07 16:05:23.110977 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 477/936] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:05:22 2022] GET /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 16:05:23.990787 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3e8cdefe-66f6-46c1-9d4a-6ac44593bebb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:23.991410 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3e8cdefe-66f6-46c1-9d4a-6ac44593bebb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:23.998563 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3e8cdefe-66f6-46c1-9d4a-6ac44593bebb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:23.999176 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3e8cdefe-66f6-46c1-9d4a-6ac44593bebb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:23.999475 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3e8cdefe-66f6-46c1-9d4a-6ac44593bebb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:24.000198 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3e8cdefe-66f6-46c1-9d4a-6ac44593bebb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:24.000653 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3e8cdefe-66f6-46c1-9d4a-6ac44593bebb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:24.001080 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3e8cdefe-66f6-46c1-9d4a-6ac44593bebb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:24.133736 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dabbe64f-83dd-43e3-9242-76a3c74d6df4 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:24.135322 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dabbe64f-83dd-43e3-9242-76a3c74d6df4 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: dc89b872-7af6-430f-ab73-119715d4cbac] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:24.139156 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-3e8cdefe-66f6-46c1-9d4a-6ac44593bebb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:24.143051 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dabbe64f-83dd-43e3-9242-76a3c74d6df4 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:24.143845 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dabbe64f-83dd-43e3-9242-76a3c74d6df4 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:24.144341 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dabbe64f-83dd-43e3-9242-76a3c74d6df4 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:24.145281 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dabbe64f-83dd-43e3-9242-76a3c74d6df4 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:24.145957 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dabbe64f-83dd-43e3-9242-76a3c74d6df4 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:24.146543 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dabbe64f-83dd-43e3-9242-76a3c74d6df4 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:24.147997 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-3e8cdefe-66f6-46c1-9d4a-6ac44593bebb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:24.149427 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-3e8cdefe-66f6-46c1-9d4a-6ac44593bebb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:24.151297 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3e8cdefe-66f6-46c1-9d4a-6ac44593bebb tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1721 microversion: 2.20 time: 0.164421 Sep 07 16:05:24.163593 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 460/937] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:05:23 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:05:24.302422 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-dabbe64f-83dd-43e3-9242-76a3c74d6df4 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:24.310103 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dabbe64f-83dd-43e3-9242-76a3c74d6df4 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac" status: 200 len: 1362 microversion: 2.1 time: 0.180726 Sep 07 16:05:24.310653 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 478/938] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:05:24 2022] GET /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 16:05:25.178041 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0c291b7a-c883-48bc-ae12-2a46c0ca86dd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:25.178773 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0c291b7a-c883-48bc-ae12-2a46c0ca86dd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:25.180763 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:05:25.186609 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0c291b7a-c883-48bc-ae12-2a46c0ca86dd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:25.187086 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0c291b7a-c883-48bc-ae12-2a46c0ca86dd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:25.187513 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0c291b7a-c883-48bc-ae12-2a46c0ca86dd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:25.188216 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0c291b7a-c883-48bc-ae12-2a46c0ca86dd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:25.188674 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0c291b7a-c883-48bc-ae12-2a46c0ca86dd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:25.189078 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0c291b7a-c883-48bc-ae12-2a46c0ca86dd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:25.333106 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bf848c04-6f05-4aa3-b873-8ced86ed790e tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:25.333711 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bf848c04-6f05-4aa3-b873-8ced86ed790e tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: dc89b872-7af6-430f-ab73-119715d4cbac] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:25.338764 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-0c291b7a-c883-48bc-ae12-2a46c0ca86dd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:25.338918 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:05:25.339411 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=10 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:05:25.344562 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf848c04-6f05-4aa3-b873-8ced86ed790e tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:25.345058 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf848c04-6f05-4aa3-b873-8ced86ed790e tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:25.345500 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf848c04-6f05-4aa3-b873-8ced86ed790e tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:25.346962 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf848c04-6f05-4aa3-b873-8ced86ed790e tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:25.347736 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf848c04-6f05-4aa3-b873-8ced86ed790e tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:25.348427 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bf848c04-6f05-4aa3-b873-8ced86ed790e tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:25.350112 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-0c291b7a-c883-48bc-ae12-2a46c0ca86dd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:25.351901 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-0c291b7a-c883-48bc-ae12-2a46c0ca86dd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:25.354273 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0c291b7a-c883-48bc-ae12-2a46c0ca86dd tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1664 microversion: 2.20 time: 0.178959 Sep 07 16:05:25.354273 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 461/939] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:05:25 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1664 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:05:25.379386 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a413ac8f-1586-4576-8bd4-cceb1823b2c8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3eb9015b-c0e3-404b-8aec-0f530d3f3468"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:05:25.382050 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a413ac8f-1586-4576-8bd4-cceb1823b2c8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:25.388403 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a413ac8f-1586-4576-8bd4-cceb1823b2c8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:25.388890 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a413ac8f-1586-4576-8bd4-cceb1823b2c8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:25.389329 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a413ac8f-1586-4576-8bd4-cceb1823b2c8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:25.390064 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a413ac8f-1586-4576-8bd4-cceb1823b2c8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:25.390519 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a413ac8f-1586-4576-8bd4-cceb1823b2c8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:25.390942 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a413ac8f-1586-4576-8bd4-cceb1823b2c8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:25.477698 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=100 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:05:25.517503 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-bf848c04-6f05-4aa3-b873-8ced86ed790e tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:25.527977 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bf848c04-6f05-4aa3-b873-8ced86ed790e tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac" status: 200 len: 1362 microversion: 2.1 time: 0.198567 Sep 07 16:05:25.528818 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 479/940] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:05:25 2022] GET /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac => generated 1362 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 16:05:25.533937 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-4583d64f-0e42-43dc-9877-bf8a32adbe49 req-686ad2ed-1457-4749-8950-422db152a033 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc89b872-7af6-430f-ab73-119715d4cbac", "name": "network-vif-plugged", "status": "completed", "tag": "4f0e45df-784a-4abe-9908-b3f4ca882014"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:05:25.545253 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-4583d64f-0e42-43dc-9877-bf8a32adbe49 req-686ad2ed-1457-4749-8950-422db152a033 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:25.546107 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-4583d64f-0e42-43dc-9877-bf8a32adbe49 req-686ad2ed-1457-4749-8950-422db152a033 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:25.546547 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-4583d64f-0e42-43dc-9877-bf8a32adbe49 req-686ad2ed-1457-4749-8950-422db152a033 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:25.568176 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-4583d64f-0e42-43dc-9877-bf8a32adbe49 req-686ad2ed-1457-4749-8950-422db152a033 service nova] Creating event network-vif-plugged:4f0e45df-784a-4abe-9908-b3f4ca882014 for instance dc89b872-7af6-430f-ab73-119715d4cbac on hv-cinder-85331 Sep 07 16:05:25.573629 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-4583d64f-0e42-43dc-9877-bf8a32adbe49 req-686ad2ed-1457-4749-8950-422db152a033 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043299 Sep 07 16:05:25.575498 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 480/941] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:05:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:05:25.746917 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a413ac8f-1586-4576-8bd4-cceb1823b2c8 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "POST /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.372227 Sep 07 16:05:25.747567 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 462/942] 10.222.0.17 () {62 vars in 1364 bytes} [Wed Sep 7 16:05:25 2022] POST /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f/os-volume_attachments => generated 188 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 16:05:25.876129 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-53024f63-c436-41d5-8952-35eb7af96581 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:25.876712 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-53024f63-c436-41d5-8952-35eb7af96581 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:25.882710 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53024f63-c436-41d5-8952-35eb7af96581 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:25.883185 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53024f63-c436-41d5-8952-35eb7af96581 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:25.883649 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53024f63-c436-41d5-8952-35eb7af96581 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:25.884331 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53024f63-c436-41d5-8952-35eb7af96581 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:25.884784 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53024f63-c436-41d5-8952-35eb7af96581 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:25.885212 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-53024f63-c436-41d5-8952-35eb7af96581 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:26.264059 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-53024f63-c436-41d5-8952-35eb7af96581 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "DELETE /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f/os-volume_attachments/3eb9015b-c0e3-404b-8aec-0f530d3f3468" status: 202 len: 0 microversion: 2.20 time: 0.392218 Sep 07 16:05:26.265258 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 481/943] 10.222.0.17 () {60 vars in 1457 bytes} [Wed Sep 7 16:05:25 2022] DELETE /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f/os-volume_attachments/3eb9015b-c0e3-404b-8aec-0f530d3f3468 => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 16:05:26.325451 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ae53c8be-a83a-4fe4-a000-072ea6d861f9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:05:26.326125 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ae53c8be-a83a-4fe4-a000-072ea6d861f9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:26.333139 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ae53c8be-a83a-4fe4-a000-072ea6d861f9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:26.333618 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ae53c8be-a83a-4fe4-a000-072ea6d861f9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:26.334047 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ae53c8be-a83a-4fe4-a000-072ea6d861f9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:26.334729 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ae53c8be-a83a-4fe4-a000-072ea6d861f9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:26.335175 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ae53c8be-a83a-4fe4-a000-072ea6d861f9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:26.335623 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ae53c8be-a83a-4fe4-a000-072ea6d861f9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:26.364317 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ae53c8be-a83a-4fe4-a000-072ea6d861f9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120641) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 07 16:05:26.428368 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ae53c8be-a83a-4fe4-a000-072ea6d861f9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "POST /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f/action" status: 202 len: 0 microversion: 2.20 time: 0.106995 Sep 07 16:05:26.429000 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 463/944] 10.222.0.17 () {62 vars in 1319 bytes} [Wed Sep 7 16:05:26 2022] POST /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 16:05:26.437538 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b74c82a1-8475-4bdd-a18c-72f430755287 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:26.438470 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b74c82a1-8475-4bdd-a18c-72f430755287 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:26.445581 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b74c82a1-8475-4bdd-a18c-72f430755287 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:26.446064 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b74c82a1-8475-4bdd-a18c-72f430755287 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:26.446500 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b74c82a1-8475-4bdd-a18c-72f430755287 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:26.447193 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b74c82a1-8475-4bdd-a18c-72f430755287 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:26.447727 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b74c82a1-8475-4bdd-a18c-72f430755287 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:26.448104 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b74c82a1-8475-4bdd-a18c-72f430755287 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:26.555197 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-72b0af6a-9bb5-45c7-ae2f-7939134bb3c3 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:26.556146 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-72b0af6a-9bb5-45c7-ae2f-7939134bb3c3 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: dc89b872-7af6-430f-ab73-119715d4cbac] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:26.568358 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72b0af6a-9bb5-45c7-ae2f-7939134bb3c3 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:26.569301 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72b0af6a-9bb5-45c7-ae2f-7939134bb3c3 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:26.569927 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72b0af6a-9bb5-45c7-ae2f-7939134bb3c3 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:26.571335 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72b0af6a-9bb5-45c7-ae2f-7939134bb3c3 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:26.572006 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72b0af6a-9bb5-45c7-ae2f-7939134bb3c3 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:26.572818 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72b0af6a-9bb5-45c7-ae2f-7939134bb3c3 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:26.585110 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b74c82a1-8475-4bdd-a18c-72f430755287 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:26.593087 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b74c82a1-8475-4bdd-a18c-72f430755287 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:26.594772 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b74c82a1-8475-4bdd-a18c-72f430755287 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:26.595958 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b74c82a1-8475-4bdd-a18c-72f430755287 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1672 microversion: 2.20 time: 0.162813 Sep 07 16:05:26.596499 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 482/945] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:05:26 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1672 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:05:26.719910 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-72b0af6a-9bb5-45c7-ae2f-7939134bb3c3 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:26.727989 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-72b0af6a-9bb5-45c7-ae2f-7939134bb3c3 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac" status: 200 len: 1362 microversion: 2.1 time: 0.178258 Sep 07 16:05:26.728551 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 464/946] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:05:26 2022] GET /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:05:27.591986 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-6141e7d5-4ebe-405c-a25d-e8c6c1587ef6 req-87719fb7-9e42-400d-bfc3-e1d5ec16fcbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08697d07-9370-4fcc-aa5b-d10000a4746f", "name": "network-vif-unplugged", "status": "completed", "tag": "08aa359d-08f5-45a8-976a-77fc0471bfe3"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:05:27.601975 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-6141e7d5-4ebe-405c-a25d-e8c6c1587ef6 req-87719fb7-9e42-400d-bfc3-e1d5ec16fcbb service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:27.602450 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-6141e7d5-4ebe-405c-a25d-e8c6c1587ef6 req-87719fb7-9e42-400d-bfc3-e1d5ec16fcbb service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:27.602881 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-6141e7d5-4ebe-405c-a25d-e8c6c1587ef6 req-87719fb7-9e42-400d-bfc3-e1d5ec16fcbb service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:27.613520 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.compute.server_external_events [req-6141e7d5-4ebe-405c-a25d-e8c6c1587ef6 req-87719fb7-9e42-400d-bfc3-e1d5ec16fcbb service nova] Unable to find a host for instance 08697d07-9370-4fcc-aa5b-d10000a4746f. Dropping event network-vif-unplugged {{(pid=120640) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 07 16:05:27.614367 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-6141e7d5-4ebe-405c-a25d-e8c6c1587ef6 req-87719fb7-9e42-400d-bfc3-e1d5ec16fcbb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026218 Sep 07 16:05:27.614915 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 483/947] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 07 16:05:27.621985 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a2e0462a-a36e-420e-8bcc-818285053e02 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:27.622589 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a2e0462a-a36e-420e-8bcc-818285053e02 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:27.629387 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a2e0462a-a36e-420e-8bcc-818285053e02 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:27.629864 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a2e0462a-a36e-420e-8bcc-818285053e02 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:27.630290 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a2e0462a-a36e-420e-8bcc-818285053e02 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:27.630975 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a2e0462a-a36e-420e-8bcc-818285053e02 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:27.631422 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a2e0462a-a36e-420e-8bcc-818285053e02 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:27.631860 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a2e0462a-a36e-420e-8bcc-818285053e02 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:27.750631 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8fc987ca-fe37-48e1-86ad-84a93e6d2ede tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:27.751815 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8fc987ca-fe37-48e1-86ad-84a93e6d2ede tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: dc89b872-7af6-430f-ab73-119715d4cbac] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:27.759005 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8fc987ca-fe37-48e1-86ad-84a93e6d2ede tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:27.759713 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8fc987ca-fe37-48e1-86ad-84a93e6d2ede tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:27.760411 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8fc987ca-fe37-48e1-86ad-84a93e6d2ede tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:27.761891 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8fc987ca-fe37-48e1-86ad-84a93e6d2ede tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:27.762471 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8fc987ca-fe37-48e1-86ad-84a93e6d2ede tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:27.763069 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8fc987ca-fe37-48e1-86ad-84a93e6d2ede tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:27.763527 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-a2e0462a-a36e-420e-8bcc-818285053e02 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:27.775767 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-a2e0462a-a36e-420e-8bcc-818285053e02 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:27.777180 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-a2e0462a-a36e-420e-8bcc-818285053e02 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:27.778336 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a2e0462a-a36e-420e-8bcc-818285053e02 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1672 microversion: 2.20 time: 0.160286 Sep 07 16:05:27.778890 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 465/948] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:05:27 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1672 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:05:27.905374 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-8fc987ca-fe37-48e1-86ad-84a93e6d2ede tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:27.913092 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8fc987ca-fe37-48e1-86ad-84a93e6d2ede tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac" status: 200 len: 1549 microversion: 2.1 time: 0.166769 Sep 07 16:05:27.913616 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 484/949] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:05:27 2022] GET /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac => generated 1549 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 16:05:27.935674 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5dec8cc6-db31-441d-a82f-3c74ebab6ecb tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:27.936172 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5dec8cc6-db31-441d-a82f-3c74ebab6ecb tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: dc89b872-7af6-430f-ab73-119715d4cbac] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:27.942770 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5dec8cc6-db31-441d-a82f-3c74ebab6ecb tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:27.943254 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5dec8cc6-db31-441d-a82f-3c74ebab6ecb tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:27.943724 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5dec8cc6-db31-441d-a82f-3c74ebab6ecb tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:27.944410 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5dec8cc6-db31-441d-a82f-3c74ebab6ecb tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:27.944864 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5dec8cc6-db31-441d-a82f-3c74ebab6ecb tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:27.945285 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5dec8cc6-db31-441d-a82f-3c74ebab6ecb tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:28.025365 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5dec8cc6-db31-441d-a82f-3c74ebab6ecb tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093519 Sep 07 16:05:28.026010 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 466/950] 10.222.0.17 () {58 vars in 1275 bytes} [Wed Sep 7 16:05:27 2022] GET /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 16:05:28.804849 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6224d15a-1f5b-44e7-8484-774035390e04 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:28.805392 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6224d15a-1f5b-44e7-8484-774035390e04 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:28.811804 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6224d15a-1f5b-44e7-8484-774035390e04 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:28.812284 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6224d15a-1f5b-44e7-8484-774035390e04 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:28.812711 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6224d15a-1f5b-44e7-8484-774035390e04 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:28.813394 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6224d15a-1f5b-44e7-8484-774035390e04 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:28.813845 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6224d15a-1f5b-44e7-8484-774035390e04 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:28.814287 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6224d15a-1f5b-44e7-8484-774035390e04 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:29.400498 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6224d15a-1f5b-44e7-8484-774035390e04 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:29.408591 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6224d15a-1f5b-44e7-8484-774035390e04 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:29.410082 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6224d15a-1f5b-44e7-8484-774035390e04 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:29.411175 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6224d15a-1f5b-44e7-8484-774035390e04 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1730 microversion: 2.20 time: 0.610328 Sep 07 16:05:29.411751 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 485/951] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:05:28 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1730 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:05:29.652117 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-894e85ce-437d-4ee9-8df4-356f77b4fa90 req-184e901b-63e1-44e7-b495-4289b60cc847 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc89b872-7af6-430f-ab73-119715d4cbac", "tag": "4f0e45df-784a-4abe-9908-b3f4ca882014"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:05:29.663807 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-894e85ce-437d-4ee9-8df4-356f77b4fa90 req-184e901b-63e1-44e7-b495-4289b60cc847 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:29.664775 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-894e85ce-437d-4ee9-8df4-356f77b4fa90 req-184e901b-63e1-44e7-b495-4289b60cc847 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:29.665311 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-894e85ce-437d-4ee9-8df4-356f77b4fa90 req-184e901b-63e1-44e7-b495-4289b60cc847 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:29.678044 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-894e85ce-437d-4ee9-8df4-356f77b4fa90 req-184e901b-63e1-44e7-b495-4289b60cc847 service nova] Creating event network-changed:4f0e45df-784a-4abe-9908-b3f4ca882014 for instance dc89b872-7af6-430f-ab73-119715d4cbac on hv-cinder-85331 Sep 07 16:05:29.683281 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-894e85ce-437d-4ee9-8df4-356f77b4fa90 req-184e901b-63e1-44e7-b495-4289b60cc847 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035472 Sep 07 16:05:29.684209 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 467/952] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:05:30.439356 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f1f04ae5-850a-4f5f-bab6-e0e7e5df2ec7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:30.440809 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f1f04ae5-850a-4f5f-bab6-e0e7e5df2ec7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:30.449203 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1f04ae5-850a-4f5f-bab6-e0e7e5df2ec7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:30.449700 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1f04ae5-850a-4f5f-bab6-e0e7e5df2ec7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:30.450141 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1f04ae5-850a-4f5f-bab6-e0e7e5df2ec7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:30.450846 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1f04ae5-850a-4f5f-bab6-e0e7e5df2ec7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:30.451561 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1f04ae5-850a-4f5f-bab6-e0e7e5df2ec7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:30.452797 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f1f04ae5-850a-4f5f-bab6-e0e7e5df2ec7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:30.659119 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f1f04ae5-850a-4f5f-bab6-e0e7e5df2ec7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:30.676976 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f1f04ae5-850a-4f5f-bab6-e0e7e5df2ec7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:30.679745 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f1f04ae5-850a-4f5f-bab6-e0e7e5df2ec7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:30.681340 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f1f04ae5-850a-4f5f-bab6-e0e7e5df2ec7 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1730 microversion: 2.20 time: 0.247037 Sep 07 16:05:30.682795 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 486/953] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:05:30 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1730 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:05:31.707737 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ae706887-fe92-4751-8aa3-3d4c02bcb42c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:31.708353 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ae706887-fe92-4751-8aa3-3d4c02bcb42c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:31.714878 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ae706887-fe92-4751-8aa3-3d4c02bcb42c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:31.715382 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ae706887-fe92-4751-8aa3-3d4c02bcb42c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:31.715911 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ae706887-fe92-4751-8aa3-3d4c02bcb42c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:31.716616 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ae706887-fe92-4751-8aa3-3d4c02bcb42c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:31.717112 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ae706887-fe92-4751-8aa3-3d4c02bcb42c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:31.717558 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ae706887-fe92-4751-8aa3-3d4c02bcb42c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:31.855909 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-ae706887-fe92-4751-8aa3-3d4c02bcb42c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:31.864831 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-ae706887-fe92-4751-8aa3-3d4c02bcb42c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:31.866282 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-ae706887-fe92-4751-8aa3-3d4c02bcb42c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:31.867452 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ae706887-fe92-4751-8aa3-3d4c02bcb42c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1730 microversion: 2.20 time: 0.164642 Sep 07 16:05:31.868036 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 468/954] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:05:31 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:05:32.895319 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-14d0bed0-0299-4544-b0c3-d8b4ceefa716 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:32.896534 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-14d0bed0-0299-4544-b0c3-d8b4ceefa716 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:32.904226 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-14d0bed0-0299-4544-b0c3-d8b4ceefa716 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:32.904690 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-14d0bed0-0299-4544-b0c3-d8b4ceefa716 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:32.908597 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-14d0bed0-0299-4544-b0c3-d8b4ceefa716 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:32.908597 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-14d0bed0-0299-4544-b0c3-d8b4ceefa716 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:32.908597 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-14d0bed0-0299-4544-b0c3-d8b4ceefa716 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:32.908597 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-14d0bed0-0299-4544-b0c3-d8b4ceefa716 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:33.055422 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-14d0bed0-0299-4544-b0c3-d8b4ceefa716 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:33.064595 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-14d0bed0-0299-4544-b0c3-d8b4ceefa716 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:33.066443 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-14d0bed0-0299-4544-b0c3-d8b4ceefa716 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:33.067706 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-14d0bed0-0299-4544-b0c3-d8b4ceefa716 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1730 microversion: 2.20 time: 0.176896 Sep 07 16:05:33.068564 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 487/955] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:05:32 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1730 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:05:34.094029 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7b71bf6f-8b7b-4955-8d4b-b36317b20a12 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:34.094673 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7b71bf6f-8b7b-4955-8d4b-b36317b20a12 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:34.102125 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b71bf6f-8b7b-4955-8d4b-b36317b20a12 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:34.102738 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b71bf6f-8b7b-4955-8d4b-b36317b20a12 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:34.103266 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b71bf6f-8b7b-4955-8d4b-b36317b20a12 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:34.104177 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b71bf6f-8b7b-4955-8d4b-b36317b20a12 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:34.104705 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b71bf6f-8b7b-4955-8d4b-b36317b20a12 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:34.105196 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7b71bf6f-8b7b-4955-8d4b-b36317b20a12 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:34.253341 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-7b71bf6f-8b7b-4955-8d4b-b36317b20a12 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:34.261671 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-7b71bf6f-8b7b-4955-8d4b-b36317b20a12 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:34.263086 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-7b71bf6f-8b7b-4955-8d4b-b36317b20a12 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:34.264319 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7b71bf6f-8b7b-4955-8d4b-b36317b20a12 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1730 microversion: 2.20 time: 0.174928 Sep 07 16:05:34.264876 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 469/956] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:05:34 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:05:35.290324 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0574d9f3-ac56-47d5-a749-89d684614f49 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:35.291145 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0574d9f3-ac56-47d5-a749-89d684614f49 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:35.297943 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0574d9f3-ac56-47d5-a749-89d684614f49 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:35.298424 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0574d9f3-ac56-47d5-a749-89d684614f49 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:35.298856 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0574d9f3-ac56-47d5-a749-89d684614f49 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:35.299563 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0574d9f3-ac56-47d5-a749-89d684614f49 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:35.300027 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0574d9f3-ac56-47d5-a749-89d684614f49 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:35.300447 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0574d9f3-ac56-47d5-a749-89d684614f49 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:35.436757 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-0574d9f3-ac56-47d5-a749-89d684614f49 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:35.445003 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-0574d9f3-ac56-47d5-a749-89d684614f49 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:35.446421 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-0574d9f3-ac56-47d5-a749-89d684614f49 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:35.447608 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0574d9f3-ac56-47d5-a749-89d684614f49 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1730 microversion: 2.20 time: 0.161153 Sep 07 16:05:35.448156 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 488/957] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:05:35 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:05:36.478220 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c93556fa-7481-464f-a2ba-46e9e9f6a6e4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:36.478963 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c93556fa-7481-464f-a2ba-46e9e9f6a6e4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:36.491199 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c93556fa-7481-464f-a2ba-46e9e9f6a6e4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:36.491572 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c93556fa-7481-464f-a2ba-46e9e9f6a6e4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:36.492016 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c93556fa-7481-464f-a2ba-46e9e9f6a6e4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:36.492714 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c93556fa-7481-464f-a2ba-46e9e9f6a6e4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:36.493163 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c93556fa-7481-464f-a2ba-46e9e9f6a6e4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:36.493582 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c93556fa-7481-464f-a2ba-46e9e9f6a6e4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:36.627671 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-c93556fa-7481-464f-a2ba-46e9e9f6a6e4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:36.636247 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-c93556fa-7481-464f-a2ba-46e9e9f6a6e4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:36.637679 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-c93556fa-7481-464f-a2ba-46e9e9f6a6e4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:36.638851 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c93556fa-7481-464f-a2ba-46e9e9f6a6e4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1730 microversion: 2.20 time: 0.164435 Sep 07 16:05:36.639409 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 470/958] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:05:36 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:05:37.664985 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e307a585-e22a-43b1-af70-5df10781f86d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:37.665687 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e307a585-e22a-43b1-af70-5df10781f86d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:37.672396 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e307a585-e22a-43b1-af70-5df10781f86d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:37.672888 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e307a585-e22a-43b1-af70-5df10781f86d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:37.673316 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e307a585-e22a-43b1-af70-5df10781f86d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:37.674017 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e307a585-e22a-43b1-af70-5df10781f86d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:37.674470 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e307a585-e22a-43b1-af70-5df10781f86d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:37.674899 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e307a585-e22a-43b1-af70-5df10781f86d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:37.809225 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e307a585-e22a-43b1-af70-5df10781f86d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:37.813752 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:05:37.819158 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e307a585-e22a-43b1-af70-5df10781f86d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:37.820620 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e307a585-e22a-43b1-af70-5df10781f86d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:37.821800 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e307a585-e22a-43b1-af70-5df10781f86d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1730 microversion: 2.20 time: 0.161096 Sep 07 16:05:37.822348 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 489/959] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:05:37 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:05:38.848797 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1a5e867a-5e54-483c-bee9-21bd12ec8f16 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:38.849614 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1a5e867a-5e54-483c-bee9-21bd12ec8f16 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:38.855797 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1a5e867a-5e54-483c-bee9-21bd12ec8f16 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:38.856315 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1a5e867a-5e54-483c-bee9-21bd12ec8f16 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:38.856756 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1a5e867a-5e54-483c-bee9-21bd12ec8f16 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:38.857477 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1a5e867a-5e54-483c-bee9-21bd12ec8f16 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:38.857911 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1a5e867a-5e54-483c-bee9-21bd12ec8f16 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:38.858342 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1a5e867a-5e54-483c-bee9-21bd12ec8f16 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:38.991107 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-1a5e867a-5e54-483c-bee9-21bd12ec8f16 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:39.000838 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-1a5e867a-5e54-483c-bee9-21bd12ec8f16 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:39.002289 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-1a5e867a-5e54-483c-bee9-21bd12ec8f16 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:39.003469 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1a5e867a-5e54-483c-bee9-21bd12ec8f16 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1730 microversion: 2.20 time: 0.159148 Sep 07 16:05:39.004116 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 471/960] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:05:38 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:05:40.029781 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-441275c9-9543-41f0-8f3b-c43c14cee734 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:40.030417 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-441275c9-9543-41f0-8f3b-c43c14cee734 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:40.039220 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-441275c9-9543-41f0-8f3b-c43c14cee734 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:40.039753 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-441275c9-9543-41f0-8f3b-c43c14cee734 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:40.040195 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-441275c9-9543-41f0-8f3b-c43c14cee734 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:40.040900 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-441275c9-9543-41f0-8f3b-c43c14cee734 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:40.041358 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-441275c9-9543-41f0-8f3b-c43c14cee734 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:40.041802 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-441275c9-9543-41f0-8f3b-c43c14cee734 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:40.168481 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-441275c9-9543-41f0-8f3b-c43c14cee734 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:40.178761 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-441275c9-9543-41f0-8f3b-c43c14cee734 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:40.180159 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-441275c9-9543-41f0-8f3b-c43c14cee734 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:40.181323 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-441275c9-9543-41f0-8f3b-c43c14cee734 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1730 microversion: 2.20 time: 0.155392 Sep 07 16:05:40.181869 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 490/961] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:05:40 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:05:41.206214 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-35cc2edf-2739-4c53-af14-215ae049b8ec tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:41.206854 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-35cc2edf-2739-4c53-af14-215ae049b8ec tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:41.213255 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35cc2edf-2739-4c53-af14-215ae049b8ec tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:41.213737 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35cc2edf-2739-4c53-af14-215ae049b8ec tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:41.214171 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35cc2edf-2739-4c53-af14-215ae049b8ec tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:41.214855 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35cc2edf-2739-4c53-af14-215ae049b8ec tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:41.215308 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35cc2edf-2739-4c53-af14-215ae049b8ec tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:41.215764 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-35cc2edf-2739-4c53-af14-215ae049b8ec tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:41.347055 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-35cc2edf-2739-4c53-af14-215ae049b8ec tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:41.355371 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-35cc2edf-2739-4c53-af14-215ae049b8ec tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:41.356836 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-35cc2edf-2739-4c53-af14-215ae049b8ec tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:41.357996 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-35cc2edf-2739-4c53-af14-215ae049b8ec tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1730 microversion: 2.20 time: 0.155697 Sep 07 16:05:41.358585 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 472/962] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:05:41 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:05:42.383074 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d22c19b7-c107-4981-a310-4736f7784a27 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:42.383729 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d22c19b7-c107-4981-a310-4736f7784a27 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:42.390110 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d22c19b7-c107-4981-a310-4736f7784a27 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:42.390580 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d22c19b7-c107-4981-a310-4736f7784a27 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:42.391009 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d22c19b7-c107-4981-a310-4736f7784a27 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:42.391721 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d22c19b7-c107-4981-a310-4736f7784a27 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:42.392168 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d22c19b7-c107-4981-a310-4736f7784a27 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:42.392587 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d22c19b7-c107-4981-a310-4736f7784a27 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:42.519682 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d22c19b7-c107-4981-a310-4736f7784a27 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:42.527667 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d22c19b7-c107-4981-a310-4736f7784a27 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:42.529088 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d22c19b7-c107-4981-a310-4736f7784a27 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:42.530725 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d22c19b7-c107-4981-a310-4736f7784a27 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1730 microversion: 2.20 time: 0.150998 Sep 07 16:05:42.531286 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 491/963] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:05:42 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:05:43.556501 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-18249059-0058-4f97-96a4-6a8eef88608d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:43.557100 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-18249059-0058-4f97-96a4-6a8eef88608d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:43.564188 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-18249059-0058-4f97-96a4-6a8eef88608d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:43.564663 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-18249059-0058-4f97-96a4-6a8eef88608d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:43.565118 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-18249059-0058-4f97-96a4-6a8eef88608d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:43.565816 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-18249059-0058-4f97-96a4-6a8eef88608d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:43.566271 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-18249059-0058-4f97-96a4-6a8eef88608d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:43.566693 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-18249059-0058-4f97-96a4-6a8eef88608d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:43.734953 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-18249059-0058-4f97-96a4-6a8eef88608d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:43.745541 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-18249059-0058-4f97-96a4-6a8eef88608d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:43.747681 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-18249059-0058-4f97-96a4-6a8eef88608d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:43.748911 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-18249059-0058-4f97-96a4-6a8eef88608d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1730 microversion: 2.20 time: 0.196398 Sep 07 16:05:43.750617 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 473/964] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:05:43 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1730 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:05:44.774521 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-00e2dad8-2dd3-4b9b-b3c4-aca0c5a049f4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:44.775083 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-00e2dad8-2dd3-4b9b-b3c4-aca0c5a049f4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:44.781579 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-00e2dad8-2dd3-4b9b-b3c4-aca0c5a049f4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:44.782057 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-00e2dad8-2dd3-4b9b-b3c4-aca0c5a049f4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:44.782492 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-00e2dad8-2dd3-4b9b-b3c4-aca0c5a049f4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:44.783173 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-00e2dad8-2dd3-4b9b-b3c4-aca0c5a049f4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:44.783717 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-00e2dad8-2dd3-4b9b-b3c4-aca0c5a049f4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:44.784142 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-00e2dad8-2dd3-4b9b-b3c4-aca0c5a049f4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:44.909705 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-00e2dad8-2dd3-4b9b-b3c4-aca0c5a049f4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:44.917762 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-00e2dad8-2dd3-4b9b-b3c4-aca0c5a049f4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:44.919178 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-00e2dad8-2dd3-4b9b-b3c4-aca0c5a049f4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:44.920358 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-00e2dad8-2dd3-4b9b-b3c4-aca0c5a049f4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1730 microversion: 2.20 time: 0.149804 Sep 07 16:05:44.920910 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 492/965] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:05:44 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:05:45.946496 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-88b6e973-7f01-4ccb-8d87-9fead6a10919 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:45.947112 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-88b6e973-7f01-4ccb-8d87-9fead6a10919 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:45.954114 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-88b6e973-7f01-4ccb-8d87-9fead6a10919 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:45.954592 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-88b6e973-7f01-4ccb-8d87-9fead6a10919 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:45.955023 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-88b6e973-7f01-4ccb-8d87-9fead6a10919 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:45.955758 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-88b6e973-7f01-4ccb-8d87-9fead6a10919 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:45.956212 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-88b6e973-7f01-4ccb-8d87-9fead6a10919 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:45.956630 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-88b6e973-7f01-4ccb-8d87-9fead6a10919 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:46.084994 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-88b6e973-7f01-4ccb-8d87-9fead6a10919 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:46.093583 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-88b6e973-7f01-4ccb-8d87-9fead6a10919 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:46.095025 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-88b6e973-7f01-4ccb-8d87-9fead6a10919 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:46.096202 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-88b6e973-7f01-4ccb-8d87-9fead6a10919 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1730 microversion: 2.20 time: 0.153669 Sep 07 16:05:46.096791 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 474/966] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:05:45 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:05:47.121492 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-09d623e7-99c2-4dad-9665-c078f6712d6c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:47.122117 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-09d623e7-99c2-4dad-9665-c078f6712d6c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:47.128623 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09d623e7-99c2-4dad-9665-c078f6712d6c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:47.129109 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09d623e7-99c2-4dad-9665-c078f6712d6c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:47.129547 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09d623e7-99c2-4dad-9665-c078f6712d6c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:47.130233 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09d623e7-99c2-4dad-9665-c078f6712d6c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:47.130689 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09d623e7-99c2-4dad-9665-c078f6712d6c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:47.131116 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-09d623e7-99c2-4dad-9665-c078f6712d6c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:47.265019 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-09d623e7-99c2-4dad-9665-c078f6712d6c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:47.272977 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-09d623e7-99c2-4dad-9665-c078f6712d6c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:47.274467 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-09d623e7-99c2-4dad-9665-c078f6712d6c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:47.275646 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-09d623e7-99c2-4dad-9665-c078f6712d6c tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1730 microversion: 2.20 time: 0.157980 Sep 07 16:05:47.276192 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 493/967] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:05:47 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:05:48.301720 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c8550d94-c92b-469d-b023-e38a98e39aef tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:48.302333 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c8550d94-c92b-469d-b023-e38a98e39aef tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:48.308956 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c8550d94-c92b-469d-b023-e38a98e39aef tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:48.309436 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c8550d94-c92b-469d-b023-e38a98e39aef tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:48.309865 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c8550d94-c92b-469d-b023-e38a98e39aef tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:48.310547 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c8550d94-c92b-469d-b023-e38a98e39aef tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:48.311049 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c8550d94-c92b-469d-b023-e38a98e39aef tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:48.312080 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c8550d94-c92b-469d-b023-e38a98e39aef tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:48.440785 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-c8550d94-c92b-469d-b023-e38a98e39aef tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:48.448775 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-c8550d94-c92b-469d-b023-e38a98e39aef tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:48.450191 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-c8550d94-c92b-469d-b023-e38a98e39aef tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:48.451340 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c8550d94-c92b-469d-b023-e38a98e39aef tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1730 microversion: 2.20 time: 0.153520 Sep 07 16:05:48.451915 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 475/968] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:05:48 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:05:49.477007 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-56af75dd-666a-478c-ad2f-d00abbceb81d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:49.477624 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-56af75dd-666a-478c-ad2f-d00abbceb81d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:49.484475 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-56af75dd-666a-478c-ad2f-d00abbceb81d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:49.484948 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-56af75dd-666a-478c-ad2f-d00abbceb81d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:49.485377 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-56af75dd-666a-478c-ad2f-d00abbceb81d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:49.486058 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-56af75dd-666a-478c-ad2f-d00abbceb81d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:49.486501 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-56af75dd-666a-478c-ad2f-d00abbceb81d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:49.486921 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-56af75dd-666a-478c-ad2f-d00abbceb81d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:49.521220 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-200bfadb-46d6-4f42-ad1d-7729892bc562 req-748d2522-3748-4ecc-abcb-025f1497a095 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08697d07-9370-4fcc-aa5b-d10000a4746f", "name": "network-vif-plugged", "status": "completed", "tag": "08aa359d-08f5-45a8-976a-77fc0471bfe3"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:05:49.533027 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-200bfadb-46d6-4f42-ad1d-7729892bc562 req-748d2522-3748-4ecc-abcb-025f1497a095 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:49.533549 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-200bfadb-46d6-4f42-ad1d-7729892bc562 req-748d2522-3748-4ecc-abcb-025f1497a095 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:49.533985 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-200bfadb-46d6-4f42-ad1d-7729892bc562 req-748d2522-3748-4ecc-abcb-025f1497a095 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:49.545615 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-200bfadb-46d6-4f42-ad1d-7729892bc562 req-748d2522-3748-4ecc-abcb-025f1497a095 service nova] Creating event network-vif-plugged:08aa359d-08f5-45a8-976a-77fc0471bfe3 for instance 08697d07-9370-4fcc-aa5b-d10000a4746f on hv-cinder-85331 Sep 07 16:05:49.550881 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-200bfadb-46d6-4f42-ad1d-7729892bc562 req-748d2522-3748-4ecc-abcb-025f1497a095 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033251 Sep 07 16:05:49.551492 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 476/969] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:05:49.631174 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-56af75dd-666a-478c-ad2f-d00abbceb81d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:49.639059 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-56af75dd-666a-478c-ad2f-d00abbceb81d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:49.641008 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-56af75dd-666a-478c-ad2f-d00abbceb81d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:49.642184 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-56af75dd-666a-478c-ad2f-d00abbceb81d tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1730 microversion: 2.20 time: 0.169337 Sep 07 16:05:49.642720 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 494/970] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:05:49 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:05:50.673228 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c44fdb9a-f5ee-4d60-8a84-705b4167feb4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:50.673936 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c44fdb9a-f5ee-4d60-8a84-705b4167feb4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:50.675890 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:05:50.682158 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c44fdb9a-f5ee-4d60-8a84-705b4167feb4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:50.682691 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c44fdb9a-f5ee-4d60-8a84-705b4167feb4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:50.683126 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c44fdb9a-f5ee-4d60-8a84-705b4167feb4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:50.683845 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c44fdb9a-f5ee-4d60-8a84-705b4167feb4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:50.684297 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c44fdb9a-f5ee-4d60-8a84-705b4167feb4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:50.684716 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c44fdb9a-f5ee-4d60-8a84-705b4167feb4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:50.811924 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-c44fdb9a-f5ee-4d60-8a84-705b4167feb4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:50.814126 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:INSERT=4,nova_cell1:SELECT=91,nova_cell1:UPDATE=5 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:05:50.821714 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-c44fdb9a-f5ee-4d60-8a84-705b4167feb4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:50.823115 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-c44fdb9a-f5ee-4d60-8a84-705b4167feb4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:50.824288 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c44fdb9a-f5ee-4d60-8a84-705b4167feb4 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1730 microversion: 2.20 time: 0.156494 Sep 07 16:05:50.824837 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 477/971] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:05:50 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:05:51.851402 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6cc2294c-fc53-4445-b506-959557aef49a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:51.852044 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6cc2294c-fc53-4445-b506-959557aef49a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:51.854374 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=38 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:05:51.861123 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cc2294c-fc53-4445-b506-959557aef49a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:51.861770 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cc2294c-fc53-4445-b506-959557aef49a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:51.862219 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cc2294c-fc53-4445-b506-959557aef49a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:51.863208 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cc2294c-fc53-4445-b506-959557aef49a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:51.863698 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cc2294c-fc53-4445-b506-959557aef49a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:51.864211 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6cc2294c-fc53-4445-b506-959557aef49a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:51.997739 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6cc2294c-fc53-4445-b506-959557aef49a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:52.006427 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6cc2294c-fc53-4445-b506-959557aef49a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:52.007874 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6cc2294c-fc53-4445-b506-959557aef49a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:52.009028 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6cc2294c-fc53-4445-b506-959557aef49a tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1730 microversion: 2.20 time: 0.163179 Sep 07 16:05:52.009582 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 495/972] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:05:51 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:05:53.036230 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-00ae294e-8be9-45c5-bad3-7a3ab7a4abfc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:53.036854 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-00ae294e-8be9-45c5-bad3-7a3ab7a4abfc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:53.044746 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00ae294e-8be9-45c5-bad3-7a3ab7a4abfc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:53.045223 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00ae294e-8be9-45c5-bad3-7a3ab7a4abfc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:53.045810 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00ae294e-8be9-45c5-bad3-7a3ab7a4abfc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:53.046502 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00ae294e-8be9-45c5-bad3-7a3ab7a4abfc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:53.046952 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00ae294e-8be9-45c5-bad3-7a3ab7a4abfc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:53.047367 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-00ae294e-8be9-45c5-bad3-7a3ab7a4abfc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:53.230053 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-00ae294e-8be9-45c5-bad3-7a3ab7a4abfc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:53.238086 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-00ae294e-8be9-45c5-bad3-7a3ab7a4abfc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:53.239490 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-00ae294e-8be9-45c5-bad3-7a3ab7a4abfc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:53.240652 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-00ae294e-8be9-45c5-bad3-7a3ab7a4abfc tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1717 microversion: 2.20 time: 0.209589 Sep 07 16:05:53.241331 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 478/973] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:05:53 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1717 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:05:54.510110 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fad68fbc-e475-4151-8cc9-88540c2da715 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:54.510651 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fad68fbc-e475-4151-8cc9-88540c2da715 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: c936130f-9f16-463d-952f-f9824ab824f4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:54.517618 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fad68fbc-e475-4151-8cc9-88540c2da715 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:54.518099 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fad68fbc-e475-4151-8cc9-88540c2da715 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:54.518536 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fad68fbc-e475-4151-8cc9-88540c2da715 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:54.519226 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fad68fbc-e475-4151-8cc9-88540c2da715 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:54.519724 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fad68fbc-e475-4151-8cc9-88540c2da715 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:54.520155 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fad68fbc-e475-4151-8cc9-88540c2da715 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:54.544145 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fad68fbc-e475-4151-8cc9-88540c2da715 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: c936130f-9f16-463d-952f-f9824ab824f4] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 16:05:54.617405 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fad68fbc-e475-4151-8cc9-88540c2da715 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c936130f-9f16-463d-952f-f9824ab824f4" status: 204 len: 0 microversion: 2.1 time: 0.110770 Sep 07 16:05:54.617782 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 496/974] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Sep 7 16:05:54 2022] DELETE /compute/v2.1/servers/c936130f-9f16-463d-952f-f9824ab824f4 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 16:05:54.626416 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6909b5c8-f9e6-4375-8caa-5cdb4e25ee54 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:54.627121 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6909b5c8-f9e6-4375-8caa-5cdb4e25ee54 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: c936130f-9f16-463d-952f-f9824ab824f4] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:54.633770 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6909b5c8-f9e6-4375-8caa-5cdb4e25ee54 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:54.634254 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6909b5c8-f9e6-4375-8caa-5cdb4e25ee54 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:54.634693 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6909b5c8-f9e6-4375-8caa-5cdb4e25ee54 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:54.635385 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6909b5c8-f9e6-4375-8caa-5cdb4e25ee54 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:54.635885 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6909b5c8-f9e6-4375-8caa-5cdb4e25ee54 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:54.636319 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6909b5c8-f9e6-4375-8caa-5cdb4e25ee54 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:54.763361 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-6909b5c8-f9e6-4375-8caa-5cdb4e25ee54 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:54.771623 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6909b5c8-f9e6-4375-8caa-5cdb4e25ee54 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/c936130f-9f16-463d-952f-f9824ab824f4" status: 200 len: 1575 microversion: 2.1 time: 0.149551 Sep 07 16:05:54.772185 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 479/975] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:05:54 2022] GET /compute/v2.1/servers/c936130f-9f16-463d-952f-f9824ab824f4 => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:05:55.795029 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e1b98100-e062-461a-855b-177cc3efc26a tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:55.795767 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e1b98100-e062-461a-855b-177cc3efc26a tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: c936130f-9f16-463d-952f-f9824ab824f4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:55.802126 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1b98100-e062-461a-855b-177cc3efc26a tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:55.802608 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1b98100-e062-461a-855b-177cc3efc26a tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:55.803045 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1b98100-e062-461a-855b-177cc3efc26a tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:55.803771 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1b98100-e062-461a-855b-177cc3efc26a tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:55.804225 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1b98100-e062-461a-855b-177cc3efc26a tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:55.804654 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e1b98100-e062-461a-855b-177cc3efc26a tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:55.988472 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e1b98100-e062-461a-855b-177cc3efc26a tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:55.996857 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e1b98100-e062-461a-855b-177cc3efc26a tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/c936130f-9f16-463d-952f-f9824ab824f4" status: 200 len: 1575 microversion: 2.1 time: 0.206259 Sep 07 16:05:55.997408 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 497/976] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:05:55 2022] GET /compute/v2.1/servers/c936130f-9f16-463d-952f-f9824ab824f4 => generated 1575 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:05:57.020305 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fdbb4934-cf0c-4237-b1bd-d712f38bc701 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:57.020918 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fdbb4934-cf0c-4237-b1bd-d712f38bc701 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: c936130f-9f16-463d-952f-f9824ab824f4] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:57.027664 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fdbb4934-cf0c-4237-b1bd-d712f38bc701 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:57.028144 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fdbb4934-cf0c-4237-b1bd-d712f38bc701 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:57.028583 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fdbb4934-cf0c-4237-b1bd-d712f38bc701 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:57.029266 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fdbb4934-cf0c-4237-b1bd-d712f38bc701 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:57.029715 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fdbb4934-cf0c-4237-b1bd-d712f38bc701 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:57.030132 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fdbb4934-cf0c-4237-b1bd-d712f38bc701 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:57.242983 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-fdbb4934-cf0c-4237-b1bd-d712f38bc701 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:57.253804 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fdbb4934-cf0c-4237-b1bd-d712f38bc701 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/c936130f-9f16-463d-952f-f9824ab824f4" status: 200 len: 1575 microversion: 2.1 time: 0.237085 Sep 07 16:05:57.254390 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 480/977] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:05:57 2022] GET /compute/v2.1/servers/c936130f-9f16-463d-952f-f9824ab824f4 => generated 1575 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:05:57.511055 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-27f07b84-3121-444e-a5b6-a1018ed88a5d req-27a08623-be0a-494c-b3b7-9f323fe2a481 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c936130f-9f16-463d-952f-f9824ab824f4", "name": "network-vif-deleted", "tag": "b9b821f4-cec8-4dc8-9e63-f93e21c903d5"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:05:57.524635 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-27f07b84-3121-444e-a5b6-a1018ed88a5d req-27a08623-be0a-494c-b3b7-9f323fe2a481 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:57.525086 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-27f07b84-3121-444e-a5b6-a1018ed88a5d req-27a08623-be0a-494c-b3b7-9f323fe2a481 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:57.525883 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-27f07b84-3121-444e-a5b6-a1018ed88a5d req-27a08623-be0a-494c-b3b7-9f323fe2a481 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:57.537997 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-27f07b84-3121-444e-a5b6-a1018ed88a5d req-27a08623-be0a-494c-b3b7-9f323fe2a481 service nova] Creating event network-vif-deleted:b9b821f4-cec8-4dc8-9e63-f93e21c903d5 for instance c936130f-9f16-463d-952f-f9824ab824f4 on hv-cinder-85331 Sep 07 16:05:57.542894 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-27f07b84-3121-444e-a5b6-a1018ed88a5d req-27a08623-be0a-494c-b3b7-9f323fe2a481 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035461 Sep 07 16:05:57.546968 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 498/978] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:05:58.277395 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e402f999-00a5-4917-b0c7-6e34d7340265 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:58.278548 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e402f999-00a5-4917-b0c7-6e34d7340265 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: c936130f-9f16-463d-952f-f9824ab824f4] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:58.287619 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e402f999-00a5-4917-b0c7-6e34d7340265 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:58.288189 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e402f999-00a5-4917-b0c7-6e34d7340265 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:58.288531 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e402f999-00a5-4917-b0c7-6e34d7340265 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:58.289585 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e402f999-00a5-4917-b0c7-6e34d7340265 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:58.290050 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e402f999-00a5-4917-b0c7-6e34d7340265 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:58.290555 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e402f999-00a5-4917-b0c7-6e34d7340265 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:58.326245 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e402f999-00a5-4917-b0c7-6e34d7340265 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:58.326747 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e402f999-00a5-4917-b0c7-6e34d7340265 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:58.327174 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e402f999-00a5-4917-b0c7-6e34d7340265 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:58.327636 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-e402f999-00a5-4917-b0c7-6e34d7340265 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lazy-loading 'fault' on Instance uuid c936130f-9f16-463d-952f-f9824ab824f4 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 16:05:58.374249 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-e402f999-00a5-4917-b0c7-6e34d7340265 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:05:58.382538 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e402f999-00a5-4917-b0c7-6e34d7340265 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/c936130f-9f16-463d-952f-f9824ab824f4" status: 200 len: 1228 microversion: 2.1 time: 0.109173 Sep 07 16:05:58.383111 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 481/979] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:05:58 2022] GET /compute/v2.1/servers/c936130f-9f16-463d-952f-f9824ab824f4 => generated 1228 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:05:59.406355 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-83cc4666-707e-4259-aac0-f5a0946621f3 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:05:59.407248 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-83cc4666-707e-4259-aac0-f5a0946621f3 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: c936130f-9f16-463d-952f-f9824ab824f4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:05:59.413402 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83cc4666-707e-4259-aac0-f5a0946621f3 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:59.413826 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83cc4666-707e-4259-aac0-f5a0946621f3 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:59.414257 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83cc4666-707e-4259-aac0-f5a0946621f3 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:59.414938 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83cc4666-707e-4259-aac0-f5a0946621f3 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:05:59.415385 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83cc4666-707e-4259-aac0-f5a0946621f3 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:05:59.415840 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83cc4666-707e-4259-aac0-f5a0946621f3 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:05:59.428519 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-83cc4666-707e-4259-aac0-f5a0946621f3 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] HTTP exception thrown: Instance c936130f-9f16-463d-952f-f9824ab824f4 could not be found. Sep 07 16:05:59.430094 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-83cc4666-707e-4259-aac0-f5a0946621f3 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Request method failure captured: Sep 07 16:05:59.430094 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/c936130f-9f16-463d-952f-f9824ab824f4 HTTP/1.1 Sep 07 16:05:59.430094 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept: application/json Sep 07 16:05:59.430094 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Sep 07 16:05:59.430094 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Connection: close Sep 07 16:05:59.430094 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Length: 0 Sep 07 16:05:59.430094 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Type: application/json Sep 07 16:05:59.430094 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Host: 10.222.0.17 Sep 07 16:05:59.430094 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Sep 07 16:05:59.430094 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Sep 07 16:05:59.430094 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjGMCaCWK5xf9_Qvk5IFgMfJDHID5TkXXoesVdgbHz0eEjX3zQJhIE6W6YFFA1AfRDMFZ9pjH-yhGyY7LOqC3Xi0awLaiFlAJwwC4L0zaoaV9ooyG1X0vA8TJJ6eSQzSsQMIz7yVkLc_Y3LHczdQ2YmI0aHfl5iA-Qj_Bve7Ps3248I00 Sep 07 16:05:59.430094 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Sep 07 16:05:59.430094 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Sep 07 16:05:59.430094 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Sep 07 16:05:59.430094 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Sep 07 16:05:59.430094 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Sep 07 16:05:59.430094 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Sep 07 16:05:59.430094 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Id: 6ef2c5a9809b4bee95a171cf6dca4e2b Sep 07 16:05:59.430094 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-TestVolumeBootPattern-1462709202 Sep 07 16:05:59.430094 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Role: reader,member Sep 07 16:05:59.430094 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Roles: reader,member Sep 07 16:05:59.431747 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6ef2c5a9809b4bee95a171cf6dca4e2b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6ef2c5a9809b4bee95a171cf6dca4e2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6ef2c5a9809b4bee95a171cf6dca4e2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6ef2c5a9809b4bee95a171cf6dca4e2b"}]}] Sep 07 16:05:59.431747 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-TestVolumeBootPattern-1462709202 Sep 07 16:05:59.431747 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Id: 6ef2c5a9809b4bee95a171cf6dca4e2b Sep 07 16:05:59.431747 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-TestVolumeBootPattern-1462709202 Sep 07 16:05:59.431747 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User: tempest-TestVolumeBootPattern-1462709202-project Sep 07 16:05:59.431747 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Sep 07 16:05:59.431747 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Sep 07 16:05:59.431747 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Id: d595f32b5f2d406b9d6ce62acec1456b Sep 07 16:05:59.431747 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-TestVolumeBootPattern-1462709202-project Sep 07 16:05:59.431747 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: method: > Sep 07 16:05:59.431747 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: exception: Instance c936130f-9f16-463d-952f-f9824ab824f4 could not be found. Sep 07 16:05:59.431747 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: action_args: {'id': 'c936130f-9f16-463d-952f-f9824ab824f4'} Sep 07 16:05:59.432710 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 16:05:59.432710 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:05:59.432710 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 16:05:59.432710 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 16:05:59.432710 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 16:05:59.432710 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 16:05:59.432710 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 16:05:59.432710 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 16:05:59.432710 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 16:05:59.432710 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 16:05:59.432710 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c936130f-9f16-463d-952f-f9824ab824f4 could not be found. Sep 07 16:05:59.432710 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:05:59.432710 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:05:59.432710 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:05:59.432710 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:05:59.432710 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:05:59.432710 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:05:59.432710 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 16:05:59.432710 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 16:05:59.432710 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 16:05:59.434313 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 16:05:59.434313 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 16:05:59.434313 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 16:05:59.434313 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 16:05:59.434313 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 16:05:59.434313 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 16:05:59.434313 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 16:05:59.434313 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c936130f-9f16-463d-952f-f9824ab824f4 could not be found. Sep 07 16:05:59.434313 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:05:59.434313 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:05:59.434313 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:05:59.434313 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:05:59.434313 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:05:59.434313 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:05:59.434313 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 16:05:59.434313 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 16:05:59.434313 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c936130f-9f16-463d-952f-f9824ab824f4 could not be found. Sep 07 16:05:59.434313 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:05:59.435727 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-83cc4666-707e-4259-aac0-f5a0946621f3 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Returning 404 to user: Instance c936130f-9f16-463d-952f-f9824ab824f4 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 16:05:59.435727 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-83cc4666-707e-4259-aac0-f5a0946621f3 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/c936130f-9f16-463d-952f-f9824ab824f4" status: 404 len: 111 microversion: 2.1 time: 0.029860 Sep 07 16:05:59.435727 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 499/980] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:05:59 2022] GET /compute/v2.1/servers/c936130f-9f16-463d-952f-f9824ab824f4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 16:05:59.527032 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a3159a37-239f-4021-bfdf-868c27475dda tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-104416188", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-415497108", "security_groups": [{"name": "tempest-secgroup-smoke-1506723329"}], "block_device_mapping_v2": [{"uuid": "8ca3ae37-657d-4ad0-8226-61996f79c4ff", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5051af4d-56b8-4439-b299-a2af35922776"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:05:59.651635 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-a3159a37-239f-4021-bfdf-868c27475dda tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] validate_networks() for [('5051af4d-56b8-4439-b299-a2af35922776', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 16:06:00.016100 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-a3159a37-239f-4021-bfdf-868c27475dda tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 16:06:00.016520 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-a3159a37-239f-4021-bfdf-868c27475dda tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 16:06:00.016992 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-a3159a37-239f-4021-bfdf-868c27475dda tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 16:06:00.017398 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-a3159a37-239f-4021-bfdf-868c27475dda tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 16:06:00.017807 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-a3159a37-239f-4021-bfdf-868c27475dda tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 16:06:00.026860 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3159a37-239f-4021-bfdf-868c27475dda tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:00.027333 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3159a37-239f-4021-bfdf-868c27475dda tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:00.027822 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3159a37-239f-4021-bfdf-868c27475dda tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:00.028543 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3159a37-239f-4021-bfdf-868c27475dda tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:00.028995 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3159a37-239f-4021-bfdf-868c27475dda tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:00.029419 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a3159a37-239f-4021-bfdf-868c27475dda tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:00.046841 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.quota [None req-a3159a37-239f-4021-bfdf-868c27475dda tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Getting quotas for project 6ef2c5a9809b4bee95a171cf6dca4e2b. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 16:06:00.051614 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.quota [None req-a3159a37-239f-4021-bfdf-868c27475dda tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Getting quotas for user d595f32b5f2d406b9d6ce62acec1456b and project 6ef2c5a9809b4bee95a171cf6dca4e2b. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 16:06:00.110282 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a3159a37-239f-4021-bfdf-868c27475dda tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 16:06:00.112555 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a3159a37-239f-4021-bfdf-868c27475dda tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 1d450d23-ad9c-43d6-a4dc-6e5c48e5292b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8ca3ae37-657d-4ad0-8226-61996f79c4ff',volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 16:06:00.240052 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a3159a37-239f-4021-bfdf-868c27475dda tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.716766 Sep 07 16:06:00.240687 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 482/981] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Sep 7 16:05:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 16:06:00.252144 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-755c93bb-4f09-4c0e-bd50-acb6466c425b tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:06:00.253279 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-755c93bb-4f09-4c0e-bd50-acb6466c425b tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 1d450d23-ad9c-43d6-a4dc-6e5c48e5292b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:06:00.308556 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-755c93bb-4f09-4c0e-bd50-acb6466c425b tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:06:00.315623 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-755c93bb-4f09-4c0e-bd50-acb6466c425b tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/1d450d23-ad9c-43d6-a4dc-6e5c48e5292b" status: 200 len: 1093 microversion: 2.1 time: 0.067722 Sep 07 16:06:00.316447 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 500/982] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:06:00 2022] GET /compute/v2.1/servers/1d450d23-ad9c-43d6-a4dc-6e5c48e5292b => generated 1093 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:06:01.337523 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b5d93319-2bda-45fe-98f3-c646ce14124d tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:06:01.338127 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b5d93319-2bda-45fe-98f3-c646ce14124d tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 1d450d23-ad9c-43d6-a4dc-6e5c48e5292b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:06:01.344798 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b5d93319-2bda-45fe-98f3-c646ce14124d tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:01.345280 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b5d93319-2bda-45fe-98f3-c646ce14124d tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:01.345710 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b5d93319-2bda-45fe-98f3-c646ce14124d tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:01.346390 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b5d93319-2bda-45fe-98f3-c646ce14124d tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:01.346841 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b5d93319-2bda-45fe-98f3-c646ce14124d tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:01.347262 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b5d93319-2bda-45fe-98f3-c646ce14124d tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:01.452005 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-b5d93319-2bda-45fe-98f3-c646ce14124d tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:06:01.466651 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b5d93319-2bda-45fe-98f3-c646ce14124d tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/1d450d23-ad9c-43d6-a4dc-6e5c48e5292b" status: 200 len: 1199 microversion: 2.1 time: 0.133423 Sep 07 16:06:01.467456 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 483/983] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:06:01 2022] GET /compute/v2.1/servers/1d450d23-ad9c-43d6-a4dc-6e5c48e5292b => generated 1199 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:06:02.490276 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a57e47fa-e846-451d-956f-a8861670d2fe tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:06:02.490812 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a57e47fa-e846-451d-956f-a8861670d2fe tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 1d450d23-ad9c-43d6-a4dc-6e5c48e5292b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:06:02.501023 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a57e47fa-e846-451d-956f-a8861670d2fe tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:02.501510 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a57e47fa-e846-451d-956f-a8861670d2fe tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:02.501947 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a57e47fa-e846-451d-956f-a8861670d2fe tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:02.502642 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a57e47fa-e846-451d-956f-a8861670d2fe tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:02.503094 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a57e47fa-e846-451d-956f-a8861670d2fe tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:02.503523 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a57e47fa-e846-451d-956f-a8861670d2fe tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:02.640151 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a57e47fa-e846-451d-956f-a8861670d2fe tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:06:02.647757 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a57e47fa-e846-451d-956f-a8861670d2fe tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/1d450d23-ad9c-43d6-a4dc-6e5c48e5292b" status: 200 len: 1265 microversion: 2.1 time: 0.161342 Sep 07 16:06:02.648316 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 501/984] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:06:02 2022] GET /compute/v2.1/servers/1d450d23-ad9c-43d6-a4dc-6e5c48e5292b => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:06:02.816724 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-df383e30-ddec-445f-b67f-1af08d233b01 req-7eb017e1-68cd-4c76-a5a1-e019f9e56bb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d450d23-ad9c-43d6-a4dc-6e5c48e5292b", "tag": "bf299e5b-1f8a-4cd6-b75a-8eb1d78dc72b"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:06:02.827048 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-df383e30-ddec-445f-b67f-1af08d233b01 req-7eb017e1-68cd-4c76-a5a1-e019f9e56bb7 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:02.827526 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-df383e30-ddec-445f-b67f-1af08d233b01 req-7eb017e1-68cd-4c76-a5a1-e019f9e56bb7 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:02.827991 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-df383e30-ddec-445f-b67f-1af08d233b01 req-7eb017e1-68cd-4c76-a5a1-e019f9e56bb7 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:02.839189 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-df383e30-ddec-445f-b67f-1af08d233b01 req-7eb017e1-68cd-4c76-a5a1-e019f9e56bb7 service nova] Creating event network-changed:bf299e5b-1f8a-4cd6-b75a-8eb1d78dc72b for instance 1d450d23-ad9c-43d6-a4dc-6e5c48e5292b on hv-cinder-85331 Sep 07 16:06:02.844013 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-df383e30-ddec-445f-b67f-1af08d233b01 req-7eb017e1-68cd-4c76-a5a1-e019f9e56bb7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031564 Sep 07 16:06:02.844607 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 484/985] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:06:03.670419 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-93733f43-2861-475a-8321-8bb6a4b4f9b7 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:06:03.671028 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-93733f43-2861-475a-8321-8bb6a4b4f9b7 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 1d450d23-ad9c-43d6-a4dc-6e5c48e5292b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:06:03.677375 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93733f43-2861-475a-8321-8bb6a4b4f9b7 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:03.677858 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93733f43-2861-475a-8321-8bb6a4b4f9b7 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:03.678296 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93733f43-2861-475a-8321-8bb6a4b4f9b7 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:03.678982 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93733f43-2861-475a-8321-8bb6a4b4f9b7 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:03.679433 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93733f43-2861-475a-8321-8bb6a4b4f9b7 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:03.679892 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93733f43-2861-475a-8321-8bb6a4b4f9b7 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:03.806606 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-93733f43-2861-475a-8321-8bb6a4b4f9b7 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:06:03.814598 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-93733f43-2861-475a-8321-8bb6a4b4f9b7 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/1d450d23-ad9c-43d6-a4dc-6e5c48e5292b" status: 200 len: 1265 microversion: 2.1 time: 0.148053 Sep 07 16:06:03.815143 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 502/986] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:06:03 2022] GET /compute/v2.1/servers/1d450d23-ad9c-43d6-a4dc-6e5c48e5292b => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:06:04.838566 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-99383184-fe28-430f-8730-ef5e788b1068 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:06:04.839264 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-99383184-fe28-430f-8730-ef5e788b1068 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 1d450d23-ad9c-43d6-a4dc-6e5c48e5292b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:06:04.845829 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99383184-fe28-430f-8730-ef5e788b1068 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:04.846308 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99383184-fe28-430f-8730-ef5e788b1068 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:04.846742 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99383184-fe28-430f-8730-ef5e788b1068 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:04.847420 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99383184-fe28-430f-8730-ef5e788b1068 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:04.848248 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99383184-fe28-430f-8730-ef5e788b1068 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:04.848671 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-99383184-fe28-430f-8730-ef5e788b1068 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:04.980862 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-99383184-fe28-430f-8730-ef5e788b1068 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:06:04.988522 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-99383184-fe28-430f-8730-ef5e788b1068 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/1d450d23-ad9c-43d6-a4dc-6e5c48e5292b" status: 200 len: 1265 microversion: 2.1 time: 0.154698 Sep 07 16:06:04.989078 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 485/987] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:06:04 2022] GET /compute/v2.1/servers/1d450d23-ad9c-43d6-a4dc-6e5c48e5292b => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:06:06.009955 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a555f53f-15c9-458a-974a-4fc9563f22e4 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:06:06.010596 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a555f53f-15c9-458a-974a-4fc9563f22e4 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 1d450d23-ad9c-43d6-a4dc-6e5c48e5292b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:06:06.017087 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a555f53f-15c9-458a-974a-4fc9563f22e4 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:06.017571 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a555f53f-15c9-458a-974a-4fc9563f22e4 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:06.018012 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a555f53f-15c9-458a-974a-4fc9563f22e4 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:06.018696 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a555f53f-15c9-458a-974a-4fc9563f22e4 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:06.019152 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a555f53f-15c9-458a-974a-4fc9563f22e4 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:06.019615 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a555f53f-15c9-458a-974a-4fc9563f22e4 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:06.148450 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a555f53f-15c9-458a-974a-4fc9563f22e4 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:06:06.156019 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a555f53f-15c9-458a-974a-4fc9563f22e4 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/1d450d23-ad9c-43d6-a4dc-6e5c48e5292b" status: 200 len: 1265 microversion: 2.1 time: 0.149935 Sep 07 16:06:06.156578 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 503/988] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:06:06 2022] GET /compute/v2.1/servers/1d450d23-ad9c-43d6-a4dc-6e5c48e5292b => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:06:07.178824 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5dcb9309-ea44-41f4-bbea-cf68f5df7b94 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:06:07.179594 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5dcb9309-ea44-41f4-bbea-cf68f5df7b94 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 1d450d23-ad9c-43d6-a4dc-6e5c48e5292b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:06:07.186726 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5dcb9309-ea44-41f4-bbea-cf68f5df7b94 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:07.187203 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5dcb9309-ea44-41f4-bbea-cf68f5df7b94 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:07.187666 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5dcb9309-ea44-41f4-bbea-cf68f5df7b94 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:07.188947 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5dcb9309-ea44-41f4-bbea-cf68f5df7b94 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:07.189399 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5dcb9309-ea44-41f4-bbea-cf68f5df7b94 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:07.189819 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5dcb9309-ea44-41f4-bbea-cf68f5df7b94 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:07.314853 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-5dcb9309-ea44-41f4-bbea-cf68f5df7b94 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:06:07.322428 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5dcb9309-ea44-41f4-bbea-cf68f5df7b94 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/1d450d23-ad9c-43d6-a4dc-6e5c48e5292b" status: 200 len: 1265 microversion: 2.1 time: 0.147494 Sep 07 16:06:07.322982 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 486/989] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:06:07 2022] GET /compute/v2.1/servers/1d450d23-ad9c-43d6-a4dc-6e5c48e5292b => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:06:08.344649 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-121dd612-17e0-42a3-9014-81fe483e5e35 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:06:08.345250 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-121dd612-17e0-42a3-9014-81fe483e5e35 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 1d450d23-ad9c-43d6-a4dc-6e5c48e5292b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:06:08.351671 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-121dd612-17e0-42a3-9014-81fe483e5e35 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:08.352144 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-121dd612-17e0-42a3-9014-81fe483e5e35 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:08.352604 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-121dd612-17e0-42a3-9014-81fe483e5e35 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:08.353281 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-121dd612-17e0-42a3-9014-81fe483e5e35 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:08.353725 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-121dd612-17e0-42a3-9014-81fe483e5e35 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:08.354143 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-121dd612-17e0-42a3-9014-81fe483e5e35 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:08.429590 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-04bd2060-6987-463c-a714-f77e83bb62f5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:06:08.430130 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-04bd2060-6987-463c-a714-f77e83bb62f5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 8ae4d7f1-1422-4346-84ab-72682ad0a928] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:06:08.436257 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04bd2060-6987-463c-a714-f77e83bb62f5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:08.436741 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04bd2060-6987-463c-a714-f77e83bb62f5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:08.437177 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04bd2060-6987-463c-a714-f77e83bb62f5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:08.437872 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04bd2060-6987-463c-a714-f77e83bb62f5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:08.438980 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04bd2060-6987-463c-a714-f77e83bb62f5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:08.440267 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-04bd2060-6987-463c-a714-f77e83bb62f5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:08.464434 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-04bd2060-6987-463c-a714-f77e83bb62f5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928/ips" status: 200 len: 151 microversion: 2.1 time: 0.038712 Sep 07 16:06:08.465201 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 487/990] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Sep 7 16:06:08 2022] GET /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 16:06:08.487775 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-121dd612-17e0-42a3-9014-81fe483e5e35 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:06:08.495511 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-121dd612-17e0-42a3-9014-81fe483e5e35 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/1d450d23-ad9c-43d6-a4dc-6e5c48e5292b" status: 200 len: 1265 microversion: 2.1 time: 0.154707 Sep 07 16:06:08.496100 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 504/991] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:06:08 2022] GET /compute/v2.1/servers/1d450d23-ad9c-43d6-a4dc-6e5c48e5292b => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:06:09.518614 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c00c0d13-4ff7-44c1-8e53-0ef5238ca145 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:06:09.519272 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c00c0d13-4ff7-44c1-8e53-0ef5238ca145 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 1d450d23-ad9c-43d6-a4dc-6e5c48e5292b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:06:09.526562 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c00c0d13-4ff7-44c1-8e53-0ef5238ca145 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:09.527082 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c00c0d13-4ff7-44c1-8e53-0ef5238ca145 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:09.527664 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c00c0d13-4ff7-44c1-8e53-0ef5238ca145 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:09.528419 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c00c0d13-4ff7-44c1-8e53-0ef5238ca145 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:09.528870 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c00c0d13-4ff7-44c1-8e53-0ef5238ca145 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:09.529292 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c00c0d13-4ff7-44c1-8e53-0ef5238ca145 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:09.663947 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-c00c0d13-4ff7-44c1-8e53-0ef5238ca145 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:06:09.671836 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c00c0d13-4ff7-44c1-8e53-0ef5238ca145 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/1d450d23-ad9c-43d6-a4dc-6e5c48e5292b" status: 200 len: 1265 microversion: 2.1 time: 0.157432 Sep 07 16:06:09.672386 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 488/992] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:06:09 2022] GET /compute/v2.1/servers/1d450d23-ad9c-43d6-a4dc-6e5c48e5292b => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:06:09.816736 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2acdcc4c-568a-40ed-b75b-4cf1e2d7b854 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f68b24e6-85ec-49db-96d4-d47157fda265"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:06:09.819141 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2acdcc4c-568a-40ed-b75b-4cf1e2d7b854 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 8ae4d7f1-1422-4346-84ab-72682ad0a928] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:06:09.825977 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2acdcc4c-568a-40ed-b75b-4cf1e2d7b854 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:09.826452 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2acdcc4c-568a-40ed-b75b-4cf1e2d7b854 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:09.826887 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2acdcc4c-568a-40ed-b75b-4cf1e2d7b854 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:09.827598 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2acdcc4c-568a-40ed-b75b-4cf1e2d7b854 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:09.828049 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2acdcc4c-568a-40ed-b75b-4cf1e2d7b854 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:09.828469 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2acdcc4c-568a-40ed-b75b-4cf1e2d7b854 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:10.313972 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:06:10.694351 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-acc82723-5153-487b-bc5c-f24bb6b0c259 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:06:10.694976 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-acc82723-5153-487b-bc5c-f24bb6b0c259 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 1d450d23-ad9c-43d6-a4dc-6e5c48e5292b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:06:10.696975 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:06:10.697801 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:06:10.704176 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-acc82723-5153-487b-bc5c-f24bb6b0c259 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:10.704667 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-acc82723-5153-487b-bc5c-f24bb6b0c259 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:10.705109 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-acc82723-5153-487b-bc5c-f24bb6b0c259 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:10.705806 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-acc82723-5153-487b-bc5c-f24bb6b0c259 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:10.706261 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-acc82723-5153-487b-bc5c-f24bb6b0c259 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:10.706688 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-acc82723-5153-487b-bc5c-f24bb6b0c259 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:10.821581 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:06:10.852164 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-acc82723-5153-487b-bc5c-f24bb6b0c259 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:06:10.860603 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-acc82723-5153-487b-bc5c-f24bb6b0c259 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/1d450d23-ad9c-43d6-a4dc-6e5c48e5292b" status: 200 len: 1265 microversion: 2.1 time: 0.170098 Sep 07 16:06:10.872062 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 489/993] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:06:10 2022] GET /compute/v2.1/servers/1d450d23-ad9c-43d6-a4dc-6e5c48e5292b => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 16:06:10.951047 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2acdcc4c-568a-40ed-b75b-4cf1e2d7b854 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "POST /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.138611 Sep 07 16:06:10.951859 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 505/994] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Sep 7 16:06:09 2022] POST /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928/os-volume_attachments => generated 194 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:06:11.883652 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-403c2779-8dfa-4e82-884d-34e228c63d43 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:06:11.884404 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-403c2779-8dfa-4e82-884d-34e228c63d43 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 1d450d23-ad9c-43d6-a4dc-6e5c48e5292b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:06:11.891240 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-403c2779-8dfa-4e82-884d-34e228c63d43 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:11.891989 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-403c2779-8dfa-4e82-884d-34e228c63d43 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:11.892791 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-403c2779-8dfa-4e82-884d-34e228c63d43 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:11.893980 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-403c2779-8dfa-4e82-884d-34e228c63d43 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:11.894516 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-403c2779-8dfa-4e82-884d-34e228c63d43 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:11.894958 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-403c2779-8dfa-4e82-884d-34e228c63d43 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:12.027743 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-403c2779-8dfa-4e82-884d-34e228c63d43 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:06:12.036010 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-403c2779-8dfa-4e82-884d-34e228c63d43 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/1d450d23-ad9c-43d6-a4dc-6e5c48e5292b" status: 200 len: 1265 microversion: 2.1 time: 0.156201 Sep 07 16:06:12.036577 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 490/995] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:06:11 2022] GET /compute/v2.1/servers/1d450d23-ad9c-43d6-a4dc-6e5c48e5292b => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:06:13.059191 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3390da58-16e0-405e-b4be-75cdba1bc639 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:06:13.059914 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3390da58-16e0-405e-b4be-75cdba1bc639 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 1d450d23-ad9c-43d6-a4dc-6e5c48e5292b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:06:13.066496 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3390da58-16e0-405e-b4be-75cdba1bc639 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:13.066973 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3390da58-16e0-405e-b4be-75cdba1bc639 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:13.067411 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3390da58-16e0-405e-b4be-75cdba1bc639 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:13.068117 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3390da58-16e0-405e-b4be-75cdba1bc639 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:13.068596 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3390da58-16e0-405e-b4be-75cdba1bc639 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:13.069021 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3390da58-16e0-405e-b4be-75cdba1bc639 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:13.198738 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3390da58-16e0-405e-b4be-75cdba1bc639 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:06:13.206579 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3390da58-16e0-405e-b4be-75cdba1bc639 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/1d450d23-ad9c-43d6-a4dc-6e5c48e5292b" status: 200 len: 1265 microversion: 2.1 time: 0.152018 Sep 07 16:06:13.207134 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 506/996] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:06:13 2022] GET /compute/v2.1/servers/1d450d23-ad9c-43d6-a4dc-6e5c48e5292b => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:06:14.229213 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5c4e54c8-8cb6-4c7f-81d2-2b8bb197d883 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:06:14.229828 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5c4e54c8-8cb6-4c7f-81d2-2b8bb197d883 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 1d450d23-ad9c-43d6-a4dc-6e5c48e5292b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:06:14.236633 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5c4e54c8-8cb6-4c7f-81d2-2b8bb197d883 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:14.237124 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5c4e54c8-8cb6-4c7f-81d2-2b8bb197d883 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:14.237565 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5c4e54c8-8cb6-4c7f-81d2-2b8bb197d883 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:14.238263 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5c4e54c8-8cb6-4c7f-81d2-2b8bb197d883 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:14.238722 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5c4e54c8-8cb6-4c7f-81d2-2b8bb197d883 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:14.239145 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5c4e54c8-8cb6-4c7f-81d2-2b8bb197d883 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:14.368513 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-5c4e54c8-8cb6-4c7f-81d2-2b8bb197d883 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:06:14.376744 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5c4e54c8-8cb6-4c7f-81d2-2b8bb197d883 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/1d450d23-ad9c-43d6-a4dc-6e5c48e5292b" status: 200 len: 1265 microversion: 2.1 time: 0.151429 Sep 07 16:06:14.377315 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 491/997] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:06:14 2022] GET /compute/v2.1/servers/1d450d23-ad9c-43d6-a4dc-6e5c48e5292b => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:06:15.399557 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6b7eacb3-f9b1-4a6d-8cce-5d9b47072fee tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:06:15.400184 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6b7eacb3-f9b1-4a6d-8cce-5d9b47072fee tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 1d450d23-ad9c-43d6-a4dc-6e5c48e5292b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:06:15.406605 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b7eacb3-f9b1-4a6d-8cce-5d9b47072fee tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:15.407667 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b7eacb3-f9b1-4a6d-8cce-5d9b47072fee tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:15.408102 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b7eacb3-f9b1-4a6d-8cce-5d9b47072fee tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:15.408780 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b7eacb3-f9b1-4a6d-8cce-5d9b47072fee tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:15.409230 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b7eacb3-f9b1-4a6d-8cce-5d9b47072fee tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:15.409678 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b7eacb3-f9b1-4a6d-8cce-5d9b47072fee tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:15.541210 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6b7eacb3-f9b1-4a6d-8cce-5d9b47072fee tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:06:15.548814 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6b7eacb3-f9b1-4a6d-8cce-5d9b47072fee tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/1d450d23-ad9c-43d6-a4dc-6e5c48e5292b" status: 200 len: 1265 microversion: 2.1 time: 0.153080 Sep 07 16:06:15.549369 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 507/998] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:06:15 2022] GET /compute/v2.1/servers/1d450d23-ad9c-43d6-a4dc-6e5c48e5292b => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:06:15.715914 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-396bef28-1228-4f1c-b073-64368102eb41 req-ce40a7d7-1836-46c9-86dd-8b1261cddf15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d450d23-ad9c-43d6-a4dc-6e5c48e5292b", "name": "network-vif-plugged", "status": "completed", "tag": "bf299e5b-1f8a-4cd6-b75a-8eb1d78dc72b"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:06:15.727290 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-396bef28-1228-4f1c-b073-64368102eb41 req-ce40a7d7-1836-46c9-86dd-8b1261cddf15 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:15.728541 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-396bef28-1228-4f1c-b073-64368102eb41 req-ce40a7d7-1836-46c9-86dd-8b1261cddf15 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:15.728966 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-396bef28-1228-4f1c-b073-64368102eb41 req-ce40a7d7-1836-46c9-86dd-8b1261cddf15 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:15.740261 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-396bef28-1228-4f1c-b073-64368102eb41 req-ce40a7d7-1836-46c9-86dd-8b1261cddf15 service nova] Creating event network-vif-plugged:bf299e5b-1f8a-4cd6-b75a-8eb1d78dc72b for instance 1d450d23-ad9c-43d6-a4dc-6e5c48e5292b on hv-cinder-85331 Sep 07 16:06:15.745199 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-396bef28-1228-4f1c-b073-64368102eb41 req-ce40a7d7-1836-46c9-86dd-8b1261cddf15 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033298 Sep 07 16:06:15.745956 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 492/999] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:06:16.571915 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5c5b5cac-e172-4c43-95d5-01c2295b859e tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:06:16.572451 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5c5b5cac-e172-4c43-95d5-01c2295b859e tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 1d450d23-ad9c-43d6-a4dc-6e5c48e5292b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:06:16.579190 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c5b5cac-e172-4c43-95d5-01c2295b859e tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:16.579856 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c5b5cac-e172-4c43-95d5-01c2295b859e tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:16.580432 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c5b5cac-e172-4c43-95d5-01c2295b859e tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:16.581125 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c5b5cac-e172-4c43-95d5-01c2295b859e tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:16.581576 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c5b5cac-e172-4c43-95d5-01c2295b859e tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:16.582002 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5c5b5cac-e172-4c43-95d5-01c2295b859e tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:16.710045 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5c5b5cac-e172-4c43-95d5-01c2295b859e tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:06:16.717675 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5c5b5cac-e172-4c43-95d5-01c2295b859e tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/1d450d23-ad9c-43d6-a4dc-6e5c48e5292b" status: 200 len: 1265 microversion: 2.1 time: 0.149709 Sep 07 16:06:16.718230 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 508/1000] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:06:16 2022] GET /compute/v2.1/servers/1d450d23-ad9c-43d6-a4dc-6e5c48e5292b => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:06:17.742044 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4ba710a7-3339-4651-a8bb-79adf0393138 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:06:17.742668 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4ba710a7-3339-4651-a8bb-79adf0393138 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 1d450d23-ad9c-43d6-a4dc-6e5c48e5292b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:06:17.749478 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4ba710a7-3339-4651-a8bb-79adf0393138 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:17.749964 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4ba710a7-3339-4651-a8bb-79adf0393138 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:17.750405 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4ba710a7-3339-4651-a8bb-79adf0393138 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:17.751096 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4ba710a7-3339-4651-a8bb-79adf0393138 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:17.751571 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4ba710a7-3339-4651-a8bb-79adf0393138 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:17.752004 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4ba710a7-3339-4651-a8bb-79adf0393138 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:17.882984 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-4ba710a7-3339-4651-a8bb-79adf0393138 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:06:17.890842 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4ba710a7-3339-4651-a8bb-79adf0393138 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/1d450d23-ad9c-43d6-a4dc-6e5c48e5292b" status: 200 len: 1265 microversion: 2.1 time: 0.153241 Sep 07 16:06:17.891522 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 493/1001] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:06:17 2022] GET /compute/v2.1/servers/1d450d23-ad9c-43d6-a4dc-6e5c48e5292b => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:06:18.917555 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ca4cdaa1-9fde-4ca1-8ad6-65b2b82da89e tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:06:18.918154 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ca4cdaa1-9fde-4ca1-8ad6-65b2b82da89e tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 1d450d23-ad9c-43d6-a4dc-6e5c48e5292b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:06:18.924502 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca4cdaa1-9fde-4ca1-8ad6-65b2b82da89e tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:18.924975 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca4cdaa1-9fde-4ca1-8ad6-65b2b82da89e tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:18.925406 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca4cdaa1-9fde-4ca1-8ad6-65b2b82da89e tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:18.926086 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca4cdaa1-9fde-4ca1-8ad6-65b2b82da89e tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:18.926532 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca4cdaa1-9fde-4ca1-8ad6-65b2b82da89e tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:18.926949 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ca4cdaa1-9fde-4ca1-8ad6-65b2b82da89e tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:19.057006 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ca4cdaa1-9fde-4ca1-8ad6-65b2b82da89e tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:06:19.065180 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ca4cdaa1-9fde-4ca1-8ad6-65b2b82da89e tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/1d450d23-ad9c-43d6-a4dc-6e5c48e5292b" status: 200 len: 1451 microversion: 2.1 time: 0.150787 Sep 07 16:06:19.065732 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 509/1002] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:06:18 2022] GET /compute/v2.1/servers/1d450d23-ad9c-43d6-a4dc-6e5c48e5292b => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:06:19.086613 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ef8d2ce1-976a-4bdb-b1e0-c08f3b9929b0 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:06:19.087233 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ef8d2ce1-976a-4bdb-b1e0-c08f3b9929b0 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 1d450d23-ad9c-43d6-a4dc-6e5c48e5292b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:06:19.093698 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ef8d2ce1-976a-4bdb-b1e0-c08f3b9929b0 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:19.094185 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ef8d2ce1-976a-4bdb-b1e0-c08f3b9929b0 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:19.094622 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ef8d2ce1-976a-4bdb-b1e0-c08f3b9929b0 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:19.095313 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ef8d2ce1-976a-4bdb-b1e0-c08f3b9929b0 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:19.095850 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ef8d2ce1-976a-4bdb-b1e0-c08f3b9929b0 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:19.096278 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ef8d2ce1-976a-4bdb-b1e0-c08f3b9929b0 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:19.224624 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-ef8d2ce1-976a-4bdb-b1e0-c08f3b9929b0 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:06:19.232334 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ef8d2ce1-976a-4bdb-b1e0-c08f3b9929b0 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/1d450d23-ad9c-43d6-a4dc-6e5c48e5292b" status: 200 len: 1451 microversion: 2.1 time: 0.149509 Sep 07 16:06:19.232896 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 494/1003] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:06:19 2022] GET /compute/v2.1/servers/1d450d23-ad9c-43d6-a4dc-6e5c48e5292b => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:06:19.553330 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-86eb2b40-39a3-4834-bf8b-d3eb6d0972ea tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Action: 'create', calling method: .version_select at 0x7ff9a5a77a60>, body: {"keypair": {"name": "tempest-keypair-1840516321", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZZ6UXojtTg/IcLCbiw4YCjXEVuO245zswmqtperV8BqAy1zTDRwrNR3QkSIfBuhJHCHCaqqQEJEdLx2RZ702vcYO3q8k8X+/ZiNOfVAbBjWpJnQwCsL3FzIyeQvoizAQ=="}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:06:19.569080 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-86eb2b40-39a3-4834-bf8b-d3eb6d0972ea tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Getting quotas for project ab1963a1a6684af58f5c240787788b60. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 16:06:19.573354 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-86eb2b40-39a3-4834-bf8b-d3eb6d0972ea tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Getting quotas for user 2dab44e593194fe788216b029eecd10c and project ab1963a1a6684af58f5c240787788b60. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 16:06:19.596534 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-86eb2b40-39a3-4834-bf8b-d3eb6d0972ea tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047066 Sep 07 16:06:19.597134 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 510/1004] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Sep 7 16:06:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:06:21.067003 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b336fc8b-37ae-44e0-b80a-ab216d2e2ae9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-446673668", "imageRef": "cfe19284-9779-46f4-b458-81d5475ec82f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "de0a3fba-a9f9-45bf-aa74-cb5014a191cb"}], "security_groups": [{"name": "tempest-securitygroup--662432710"}], "key_name": "tempest-keypair-1840516321", "user_data": "}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:06:21.075885 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:06:21.203814 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-b336fc8b-37ae-44e0-b80a-ab216d2e2ae9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] validate_networks() for [('de0a3fba-a9f9-45bf-aa74-cb5014a191cb', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 16:06:21.304405 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-7511d9bc-b028-483a-bb52-6526ff52b2be req-b6f8743f-4f3e-433b-8654-19743e9e2449 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d450d23-ad9c-43d6-a4dc-6e5c48e5292b", "tag": "bf299e5b-1f8a-4cd6-b75a-8eb1d78dc72b"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:06:21.315617 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-7511d9bc-b028-483a-bb52-6526ff52b2be req-b6f8743f-4f3e-433b-8654-19743e9e2449 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:21.316384 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-7511d9bc-b028-483a-bb52-6526ff52b2be req-b6f8743f-4f3e-433b-8654-19743e9e2449 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:21.316980 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-7511d9bc-b028-483a-bb52-6526ff52b2be req-b6f8743f-4f3e-433b-8654-19743e9e2449 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:21.328158 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-7511d9bc-b028-483a-bb52-6526ff52b2be req-b6f8743f-4f3e-433b-8654-19743e9e2449 service nova] Creating event network-changed:bf299e5b-1f8a-4cd6-b75a-8eb1d78dc72b for instance 1d450d23-ad9c-43d6-a4dc-6e5c48e5292b on hv-cinder-85331 Sep 07 16:06:21.334147 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-7511d9bc-b028-483a-bb52-6526ff52b2be req-b6f8743f-4f3e-433b-8654-19743e9e2449 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033934 Sep 07 16:06:21.335203 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 511/1005] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 16:06:21.792065 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-b336fc8b-37ae-44e0-b80a-ab216d2e2ae9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 16:06:21.792486 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-b336fc8b-37ae-44e0-b80a-ab216d2e2ae9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 16:06:21.792999 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-b336fc8b-37ae-44e0-b80a-ab216d2e2ae9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 16:06:21.793413 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-b336fc8b-37ae-44e0-b80a-ab216d2e2ae9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 16:06:21.793827 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-b336fc8b-37ae-44e0-b80a-ab216d2e2ae9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 16:06:21.802963 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b336fc8b-37ae-44e0-b80a-ab216d2e2ae9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:21.803452 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b336fc8b-37ae-44e0-b80a-ab216d2e2ae9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:21.803912 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b336fc8b-37ae-44e0-b80a-ab216d2e2ae9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:21.804644 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b336fc8b-37ae-44e0-b80a-ab216d2e2ae9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:21.805122 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b336fc8b-37ae-44e0-b80a-ab216d2e2ae9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:21.805739 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b336fc8b-37ae-44e0-b80a-ab216d2e2ae9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:21.823727 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.quota [None req-b336fc8b-37ae-44e0-b80a-ab216d2e2ae9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Getting quotas for project ab1963a1a6684af58f5c240787788b60. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 16:06:21.828935 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.quota [None req-b336fc8b-37ae-44e0-b80a-ab216d2e2ae9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Getting quotas for user 2dab44e593194fe788216b029eecd10c and project ab1963a1a6684af58f5c240787788b60. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 16:06:21.841242 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b336fc8b-37ae-44e0-b80a-ab216d2e2ae9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 16:06:21.844240 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b336fc8b-37ae-44e0-b80a-ab216d2e2ae9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: d43ccf07-e0c3-46a2-b4f2-00db2672aced] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cfe19284-9779-46f4-b458-81d5475ec82f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 16:06:21.895685 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b336fc8b-37ae-44e0-b80a-ab216d2e2ae9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.832949 Sep 07 16:06:21.897667 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 495/1006] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Sep 7 16:06:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 16:06:21.909897 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b6811795-4819-42af-82c4-a96e22150704 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:06:21.910604 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b6811795-4819-42af-82c4-a96e22150704 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: d43ccf07-e0c3-46a2-b4f2-00db2672aced] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:06:21.927917 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:06:21.990281 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b6811795-4819-42af-82c4-a96e22150704 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:06:21.997801 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b6811795-4819-42af-82c4-a96e22150704 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/d43ccf07-e0c3-46a2-b4f2-00db2672aced" status: 200 len: 1241 microversion: 2.1 time: 0.092538 Sep 07 16:06:22.000169 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 512/1007] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:06:21 2022] GET /compute/v2.1/servers/d43ccf07-e0c3-46a2-b4f2-00db2672aced => generated 1241 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:06:23.023267 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2441a01b-5318-49b1-b215-4e2444904f4c tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:06:23.023957 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2441a01b-5318-49b1-b215-4e2444904f4c tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: d43ccf07-e0c3-46a2-b4f2-00db2672aced] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:06:23.030767 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2441a01b-5318-49b1-b215-4e2444904f4c tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:23.031275 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2441a01b-5318-49b1-b215-4e2444904f4c tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:23.031743 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2441a01b-5318-49b1-b215-4e2444904f4c tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:23.032436 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2441a01b-5318-49b1-b215-4e2444904f4c tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:23.032895 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2441a01b-5318-49b1-b215-4e2444904f4c tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:23.034016 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2441a01b-5318-49b1-b215-4e2444904f4c tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:23.052574 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=97 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:06:23.097152 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-2441a01b-5318-49b1-b215-4e2444904f4c tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:06:23.105082 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2441a01b-5318-49b1-b215-4e2444904f4c tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/d43ccf07-e0c3-46a2-b4f2-00db2672aced" status: 200 len: 1293 microversion: 2.1 time: 0.086154 Sep 07 16:06:23.105650 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 496/1008] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:06:23 2022] GET /compute/v2.1/servers/d43ccf07-e0c3-46a2-b4f2-00db2672aced => generated 1293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:06:24.128107 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-46b0bb84-8047-4ec5-933b-3a999a34d8a8 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:06:24.128648 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-46b0bb84-8047-4ec5-933b-3a999a34d8a8 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: d43ccf07-e0c3-46a2-b4f2-00db2672aced] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:06:24.135865 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-46b0bb84-8047-4ec5-933b-3a999a34d8a8 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:24.136351 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-46b0bb84-8047-4ec5-933b-3a999a34d8a8 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:24.136789 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-46b0bb84-8047-4ec5-933b-3a999a34d8a8 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:24.137479 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-46b0bb84-8047-4ec5-933b-3a999a34d8a8 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:24.137940 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-46b0bb84-8047-4ec5-933b-3a999a34d8a8 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:24.138366 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-46b0bb84-8047-4ec5-933b-3a999a34d8a8 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:24.267556 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-46b0bb84-8047-4ec5-933b-3a999a34d8a8 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:06:24.275460 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-46b0bb84-8047-4ec5-933b-3a999a34d8a8 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/d43ccf07-e0c3-46a2-b4f2-00db2672aced" status: 200 len: 1366 microversion: 2.1 time: 0.151206 Sep 07 16:06:24.276063 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 513/1009] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:06:24 2022] GET /compute/v2.1/servers/d43ccf07-e0c3-46a2-b4f2-00db2672aced => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:06:24.692415 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-5b25c47b-de2f-4d32-9c5a-4a308cb7fa35 req-6c57d9ab-1321-4985-b1f9-b0b477fce072 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d43ccf07-e0c3-46a2-b4f2-00db2672aced", "tag": "e730ca93-f556-47b1-a83d-b233763cbdfb"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:06:24.702479 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-5b25c47b-de2f-4d32-9c5a-4a308cb7fa35 req-6c57d9ab-1321-4985-b1f9-b0b477fce072 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:24.703063 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-5b25c47b-de2f-4d32-9c5a-4a308cb7fa35 req-6c57d9ab-1321-4985-b1f9-b0b477fce072 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:24.703501 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-5b25c47b-de2f-4d32-9c5a-4a308cb7fa35 req-6c57d9ab-1321-4985-b1f9-b0b477fce072 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:24.718413 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-5b25c47b-de2f-4d32-9c5a-4a308cb7fa35 req-6c57d9ab-1321-4985-b1f9-b0b477fce072 service nova] Creating event network-changed:e730ca93-f556-47b1-a83d-b233763cbdfb for instance d43ccf07-e0c3-46a2-b4f2-00db2672aced on hv-cinder-85331 Sep 07 16:06:24.723697 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-5b25c47b-de2f-4d32-9c5a-4a308cb7fa35 req-6c57d9ab-1321-4985-b1f9-b0b477fce072 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035462 Sep 07 16:06:24.724734 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 497/1010] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:06:25.299849 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-05625981-544c-4792-acbf-e180ca96dc00 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:06:25.300406 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-05625981-544c-4792-acbf-e180ca96dc00 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: d43ccf07-e0c3-46a2-b4f2-00db2672aced] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:06:25.306779 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-05625981-544c-4792-acbf-e180ca96dc00 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:25.307250 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-05625981-544c-4792-acbf-e180ca96dc00 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:25.307707 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-05625981-544c-4792-acbf-e180ca96dc00 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:25.308453 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-05625981-544c-4792-acbf-e180ca96dc00 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:25.308899 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-05625981-544c-4792-acbf-e180ca96dc00 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:25.309316 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-05625981-544c-4792-acbf-e180ca96dc00 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:25.438747 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-05625981-544c-4792-acbf-e180ca96dc00 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:06:25.446391 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-05625981-544c-4792-acbf-e180ca96dc00 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/d43ccf07-e0c3-46a2-b4f2-00db2672aced" status: 200 len: 1366 microversion: 2.1 time: 0.151034 Sep 07 16:06:25.446958 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 514/1011] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:06:25 2022] GET /compute/v2.1/servers/d43ccf07-e0c3-46a2-b4f2-00db2672aced => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:06:26.471598 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-38173faa-88ab-4024-b438-e9f68bed5bcf tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:06:26.472209 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-38173faa-88ab-4024-b438-e9f68bed5bcf tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: d43ccf07-e0c3-46a2-b4f2-00db2672aced] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:06:26.478914 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-38173faa-88ab-4024-b438-e9f68bed5bcf tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:26.479394 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-38173faa-88ab-4024-b438-e9f68bed5bcf tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:26.479852 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-38173faa-88ab-4024-b438-e9f68bed5bcf tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:26.480600 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-38173faa-88ab-4024-b438-e9f68bed5bcf tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:26.480991 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-38173faa-88ab-4024-b438-e9f68bed5bcf tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:26.481413 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-38173faa-88ab-4024-b438-e9f68bed5bcf tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:26.620728 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-38173faa-88ab-4024-b438-e9f68bed5bcf tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:06:26.629001 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-38173faa-88ab-4024-b438-e9f68bed5bcf tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/d43ccf07-e0c3-46a2-b4f2-00db2672aced" status: 200 len: 1366 microversion: 2.1 time: 0.163210 Sep 07 16:06:26.629590 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 498/1012] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:06:26 2022] GET /compute/v2.1/servers/d43ccf07-e0c3-46a2-b4f2-00db2672aced => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:06:27.654579 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6b321ba8-611e-4e24-bd24-81c905c7933c tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:06:27.655179 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6b321ba8-611e-4e24-bd24-81c905c7933c tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: d43ccf07-e0c3-46a2-b4f2-00db2672aced] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:06:27.662671 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b321ba8-611e-4e24-bd24-81c905c7933c tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:27.663148 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b321ba8-611e-4e24-bd24-81c905c7933c tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:27.663634 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b321ba8-611e-4e24-bd24-81c905c7933c tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:27.664335 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b321ba8-611e-4e24-bd24-81c905c7933c tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:27.664783 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b321ba8-611e-4e24-bd24-81c905c7933c tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:27.665202 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b321ba8-611e-4e24-bd24-81c905c7933c tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:27.798297 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6b321ba8-611e-4e24-bd24-81c905c7933c tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:06:27.806132 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6b321ba8-611e-4e24-bd24-81c905c7933c tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/d43ccf07-e0c3-46a2-b4f2-00db2672aced" status: 200 len: 1366 microversion: 2.1 time: 0.155582 Sep 07 16:06:27.806702 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 515/1013] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:06:27 2022] GET /compute/v2.1/servers/d43ccf07-e0c3-46a2-b4f2-00db2672aced => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:06:28.829699 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-80f8bdf1-4bc2-4999-b49a-be29d82ae0d6 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:06:28.830756 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-80f8bdf1-4bc2-4999-b49a-be29d82ae0d6 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: d43ccf07-e0c3-46a2-b4f2-00db2672aced] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:06:28.837408 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-80f8bdf1-4bc2-4999-b49a-be29d82ae0d6 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:28.837898 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-80f8bdf1-4bc2-4999-b49a-be29d82ae0d6 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:28.838330 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-80f8bdf1-4bc2-4999-b49a-be29d82ae0d6 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:28.839011 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-80f8bdf1-4bc2-4999-b49a-be29d82ae0d6 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:28.839461 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-80f8bdf1-4bc2-4999-b49a-be29d82ae0d6 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:28.839904 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-80f8bdf1-4bc2-4999-b49a-be29d82ae0d6 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:28.968131 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-80f8bdf1-4bc2-4999-b49a-be29d82ae0d6 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:06:28.976585 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-80f8bdf1-4bc2-4999-b49a-be29d82ae0d6 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/d43ccf07-e0c3-46a2-b4f2-00db2672aced" status: 200 len: 1366 microversion: 2.1 time: 0.150857 Sep 07 16:06:28.977141 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 499/1014] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:06:28 2022] GET /compute/v2.1/servers/d43ccf07-e0c3-46a2-b4f2-00db2672aced => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:06:29.999389 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-11ffcb7c-b921-40fc-a3cb-095ce8712b5e tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:06:30.000023 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-11ffcb7c-b921-40fc-a3cb-095ce8712b5e tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: d43ccf07-e0c3-46a2-b4f2-00db2672aced] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:06:30.006664 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-11ffcb7c-b921-40fc-a3cb-095ce8712b5e tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:30.007140 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-11ffcb7c-b921-40fc-a3cb-095ce8712b5e tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:30.007599 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-11ffcb7c-b921-40fc-a3cb-095ce8712b5e tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:30.008327 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-11ffcb7c-b921-40fc-a3cb-095ce8712b5e tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:30.008757 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-11ffcb7c-b921-40fc-a3cb-095ce8712b5e tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:30.009176 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-11ffcb7c-b921-40fc-a3cb-095ce8712b5e tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:30.143163 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-11ffcb7c-b921-40fc-a3cb-095ce8712b5e tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:06:30.150777 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-11ffcb7c-b921-40fc-a3cb-095ce8712b5e tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/d43ccf07-e0c3-46a2-b4f2-00db2672aced" status: 200 len: 1366 microversion: 2.1 time: 0.155321 Sep 07 16:06:30.151324 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 516/1015] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:06:29 2022] GET /compute/v2.1/servers/d43ccf07-e0c3-46a2-b4f2-00db2672aced => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:06:31.173215 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0bb2d3bf-fa35-4635-a0a9-cc6e56839c02 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:06:31.173822 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0bb2d3bf-fa35-4635-a0a9-cc6e56839c02 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: d43ccf07-e0c3-46a2-b4f2-00db2672aced] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:06:31.180247 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0bb2d3bf-fa35-4635-a0a9-cc6e56839c02 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:31.180737 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0bb2d3bf-fa35-4635-a0a9-cc6e56839c02 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:31.181162 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0bb2d3bf-fa35-4635-a0a9-cc6e56839c02 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:31.181828 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0bb2d3bf-fa35-4635-a0a9-cc6e56839c02 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:31.182274 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0bb2d3bf-fa35-4635-a0a9-cc6e56839c02 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:31.182692 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0bb2d3bf-fa35-4635-a0a9-cc6e56839c02 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:31.306447 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-0bb2d3bf-fa35-4635-a0a9-cc6e56839c02 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:06:31.314109 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0bb2d3bf-fa35-4635-a0a9-cc6e56839c02 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/d43ccf07-e0c3-46a2-b4f2-00db2672aced" status: 200 len: 1366 microversion: 2.1 time: 0.144736 Sep 07 16:06:31.314663 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 500/1016] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:06:31 2022] GET /compute/v2.1/servers/d43ccf07-e0c3-46a2-b4f2-00db2672aced => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:06:31.762575 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-40bd2b04-f933-4341-8a15-d944c2b53fd5 req-7ba2b232-c8b2-4b07-90c6-98ba5757f41c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d43ccf07-e0c3-46a2-b4f2-00db2672aced", "name": "network-vif-plugged", "status": "completed", "tag": "e730ca93-f556-47b1-a83d-b233763cbdfb"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:06:31.774146 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-40bd2b04-f933-4341-8a15-d944c2b53fd5 req-7ba2b232-c8b2-4b07-90c6-98ba5757f41c service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:31.774628 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-40bd2b04-f933-4341-8a15-d944c2b53fd5 req-7ba2b232-c8b2-4b07-90c6-98ba5757f41c service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:31.775065 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-40bd2b04-f933-4341-8a15-d944c2b53fd5 req-7ba2b232-c8b2-4b07-90c6-98ba5757f41c service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:31.786081 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-40bd2b04-f933-4341-8a15-d944c2b53fd5 req-7ba2b232-c8b2-4b07-90c6-98ba5757f41c service nova] Creating event network-vif-plugged:e730ca93-f556-47b1-a83d-b233763cbdfb for instance d43ccf07-e0c3-46a2-b4f2-00db2672aced on hv-cinder-85331 Sep 07 16:06:31.791041 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-40bd2b04-f933-4341-8a15-d944c2b53fd5 req-7ba2b232-c8b2-4b07-90c6-98ba5757f41c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032219 Sep 07 16:06:31.791648 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 517/1017] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:06:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:06:32.336876 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5e15cfd9-b2c1-4859-98f1-d7b20d291f48 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:06:32.337421 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5e15cfd9-b2c1-4859-98f1-d7b20d291f48 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: d43ccf07-e0c3-46a2-b4f2-00db2672aced] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:06:32.339355 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:06:32.340026 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:06:32.346686 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5e15cfd9-b2c1-4859-98f1-d7b20d291f48 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:32.347165 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5e15cfd9-b2c1-4859-98f1-d7b20d291f48 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:32.347880 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5e15cfd9-b2c1-4859-98f1-d7b20d291f48 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:32.348560 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5e15cfd9-b2c1-4859-98f1-d7b20d291f48 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:32.349009 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5e15cfd9-b2c1-4859-98f1-d7b20d291f48 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:32.349428 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5e15cfd9-b2c1-4859-98f1-d7b20d291f48 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:32.477509 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-5e15cfd9-b2c1-4859-98f1-d7b20d291f48 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:06:32.485235 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5e15cfd9-b2c1-4859-98f1-d7b20d291f48 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/d43ccf07-e0c3-46a2-b4f2-00db2672aced" status: 200 len: 1366 microversion: 2.1 time: 0.152201 Sep 07 16:06:32.485798 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 501/1018] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:06:32 2022] GET /compute/v2.1/servers/d43ccf07-e0c3-46a2-b4f2-00db2672aced => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:06:33.508931 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f30dc098-66bb-4d4a-a556-59796e257071 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:06:33.509621 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f30dc098-66bb-4d4a-a556-59796e257071 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: d43ccf07-e0c3-46a2-b4f2-00db2672aced] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:06:33.511713 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=6 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:06:33.518146 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f30dc098-66bb-4d4a-a556-59796e257071 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:33.518680 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f30dc098-66bb-4d4a-a556-59796e257071 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:33.519118 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f30dc098-66bb-4d4a-a556-59796e257071 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:33.519839 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f30dc098-66bb-4d4a-a556-59796e257071 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:33.520293 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f30dc098-66bb-4d4a-a556-59796e257071 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:33.520713 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f30dc098-66bb-4d4a-a556-59796e257071 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:33.647951 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f30dc098-66bb-4d4a-a556-59796e257071 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:06:33.657126 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f30dc098-66bb-4d4a-a556-59796e257071 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/d43ccf07-e0c3-46a2-b4f2-00db2672aced" status: 200 len: 1366 microversion: 2.1 time: 0.152273 Sep 07 16:06:33.658512 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 518/1019] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:06:33 2022] GET /compute/v2.1/servers/d43ccf07-e0c3-46a2-b4f2-00db2672aced => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:06:34.681586 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b9bb49ef-58d3-4396-a1e1-9f6002da1050 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:06:34.682195 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b9bb49ef-58d3-4396-a1e1-9f6002da1050 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: d43ccf07-e0c3-46a2-b4f2-00db2672aced] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:06:34.688641 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b9bb49ef-58d3-4396-a1e1-9f6002da1050 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:34.689624 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b9bb49ef-58d3-4396-a1e1-9f6002da1050 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:34.690057 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b9bb49ef-58d3-4396-a1e1-9f6002da1050 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:34.690744 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b9bb49ef-58d3-4396-a1e1-9f6002da1050 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:34.691199 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b9bb49ef-58d3-4396-a1e1-9f6002da1050 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:34.691652 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b9bb49ef-58d3-4396-a1e1-9f6002da1050 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:34.816793 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-b9bb49ef-58d3-4396-a1e1-9f6002da1050 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:06:34.824388 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b9bb49ef-58d3-4396-a1e1-9f6002da1050 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/d43ccf07-e0c3-46a2-b4f2-00db2672aced" status: 200 len: 1556 microversion: 2.1 time: 0.146704 Sep 07 16:06:34.824947 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 502/1020] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:06:34 2022] GET /compute/v2.1/servers/d43ccf07-e0c3-46a2-b4f2-00db2672aced => generated 1556 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:06:34.846504 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-74d92157-da04-4ae9-ab46-7058fdb57b1b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:06:34.847007 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-74d92157-da04-4ae9-ab46-7058fdb57b1b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: d43ccf07-e0c3-46a2-b4f2-00db2672aced] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:06:34.853507 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74d92157-da04-4ae9-ab46-7058fdb57b1b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:34.854007 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74d92157-da04-4ae9-ab46-7058fdb57b1b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:34.854442 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74d92157-da04-4ae9-ab46-7058fdb57b1b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:34.855118 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74d92157-da04-4ae9-ab46-7058fdb57b1b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:34.855571 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74d92157-da04-4ae9-ab46-7058fdb57b1b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:34.855989 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-74d92157-da04-4ae9-ab46-7058fdb57b1b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:34.930385 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-74d92157-da04-4ae9-ab46-7058fdb57b1b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/d43ccf07-e0c3-46a2-b4f2-00db2672aced/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087710 Sep 07 16:06:34.930971 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 519/1021] 10.222.0.17 () {58 vars in 1275 bytes} [Wed Sep 7 16:06:34 2022] GET /compute/v2.1/servers/d43ccf07-e0c3-46a2-b4f2-00db2672aced/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:06:36.078096 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-dd07c510-fc77-4c04-8fc1-c0fd774c1fbd req-f83c86bd-7d03-400f-8f2b-b9a2d9a00816 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d43ccf07-e0c3-46a2-b4f2-00db2672aced", "tag": "e730ca93-f556-47b1-a83d-b233763cbdfb"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:06:36.088620 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-dd07c510-fc77-4c04-8fc1-c0fd774c1fbd req-f83c86bd-7d03-400f-8f2b-b9a2d9a00816 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:36.089105 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-dd07c510-fc77-4c04-8fc1-c0fd774c1fbd req-f83c86bd-7d03-400f-8f2b-b9a2d9a00816 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:36.089537 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-dd07c510-fc77-4c04-8fc1-c0fd774c1fbd req-f83c86bd-7d03-400f-8f2b-b9a2d9a00816 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:36.100600 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-dd07c510-fc77-4c04-8fc1-c0fd774c1fbd req-f83c86bd-7d03-400f-8f2b-b9a2d9a00816 service nova] Creating event network-changed:e730ca93-f556-47b1-a83d-b233763cbdfb for instance d43ccf07-e0c3-46a2-b4f2-00db2672aced on hv-cinder-85331 Sep 07 16:06:36.105791 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-dd07c510-fc77-4c04-8fc1-c0fd774c1fbd req-f83c86bd-7d03-400f-8f2b-b9a2d9a00816 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031354 Sep 07 16:06:36.106553 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 503/1022] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:06:48.078307 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=17 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:06:48.079060 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=66,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:06:48.083146 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c849809d-0e46-4c10-bdd5-d3b94311f673 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:06:48.083672 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c849809d-0e46-4c10-bdd5-d3b94311f673 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: dc89b872-7af6-430f-ab73-119715d4cbac] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:06:48.090754 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c849809d-0e46-4c10-bdd5-d3b94311f673 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:48.091238 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c849809d-0e46-4c10-bdd5-d3b94311f673 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:48.091704 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c849809d-0e46-4c10-bdd5-d3b94311f673 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:48.092396 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c849809d-0e46-4c10-bdd5-d3b94311f673 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:48.092848 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c849809d-0e46-4c10-bdd5-d3b94311f673 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:48.093273 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c849809d-0e46-4c10-bdd5-d3b94311f673 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:48.118160 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c849809d-0e46-4c10-bdd5-d3b94311f673 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac/ips" status: 200 len: 147 microversion: 2.1 time: 0.041189 Sep 07 16:06:48.118719 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 520/1023] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Sep 7 16:06:48 2022] GET /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac/ips => generated 147 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:06:49.449353 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5b76da64-3bea-4a70-84ea-b2c83214a1f3 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9f8bdfa8-2dce-4cf4-a768-e7e82abf132e"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:06:49.451939 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5b76da64-3bea-4a70-84ea-b2c83214a1f3 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: dc89b872-7af6-430f-ab73-119715d4cbac] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:06:49.454080 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:06:49.454716 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=36 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:06:49.461074 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5b76da64-3bea-4a70-84ea-b2c83214a1f3 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:49.461559 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5b76da64-3bea-4a70-84ea-b2c83214a1f3 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:49.461995 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5b76da64-3bea-4a70-84ea-b2c83214a1f3 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:49.462682 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5b76da64-3bea-4a70-84ea-b2c83214a1f3 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:49.463138 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5b76da64-3bea-4a70-84ea-b2c83214a1f3 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:49.463585 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5b76da64-3bea-4a70-84ea-b2c83214a1f3 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:49.737170 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5b76da64-3bea-4a70-84ea-b2c83214a1f3 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "POST /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291022 Sep 07 16:06:49.737803 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 504/1024] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Sep 7 16:06:49 2022] POST /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:06:57.270308 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c9280a68-5aba-4bd4-a63c-e7cc14536112 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:06:57.272478 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c9280a68-5aba-4bd4-a63c-e7cc14536112 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: dc89b872-7af6-430f-ab73-119715d4cbac] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:06:57.278762 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9280a68-5aba-4bd4-a63c-e7cc14536112 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:57.279231 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9280a68-5aba-4bd4-a63c-e7cc14536112 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:57.279694 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9280a68-5aba-4bd4-a63c-e7cc14536112 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:57.280371 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9280a68-5aba-4bd4-a63c-e7cc14536112 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:57.280816 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9280a68-5aba-4bd4-a63c-e7cc14536112 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:57.281233 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c9280a68-5aba-4bd4-a63c-e7cc14536112 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:57.309832 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c9280a68-5aba-4bd4-a63c-e7cc14536112 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043906 Sep 07 16:06:57.310362 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 521/1025] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Sep 7 16:06:57 2022] GET /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:06:57.321425 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f577f325-1e00-4d63-a922-df69a2d86259 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:06:57.321996 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f577f325-1e00-4d63-a922-df69a2d86259 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: dc89b872-7af6-430f-ab73-119715d4cbac] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:06:57.328670 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f577f325-1e00-4d63-a922-df69a2d86259 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:57.329151 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f577f325-1e00-4d63-a922-df69a2d86259 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:57.329583 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f577f325-1e00-4d63-a922-df69a2d86259 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:57.330264 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f577f325-1e00-4d63-a922-df69a2d86259 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:57.331267 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f577f325-1e00-4d63-a922-df69a2d86259 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:57.331723 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f577f325-1e00-4d63-a922-df69a2d86259 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:57.361014 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f577f325-1e00-4d63-a922-df69a2d86259 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac/os-volume_attachments/9f8bdfa8-2dce-4cf4-a768-e7e82abf132e" status: 200 len: 194 microversion: 2.1 time: 0.043848 Sep 07 16:06:57.361589 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 505/1026] 10.222.0.17 () {58 vars in 1413 bytes} [Wed Sep 7 16:06:57 2022] GET /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac/os-volume_attachments/9f8bdfa8-2dce-4cf4-a768-e7e82abf132e => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:06:58.693395 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-97415867-edae-4b7b-baaf-01118b127c4e tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55ca46be-5ee2-4fb8-b845-abd63dd4c21c"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:06:58.695761 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-97415867-edae-4b7b-baaf-01118b127c4e tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: dc89b872-7af6-430f-ab73-119715d4cbac] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:06:58.702247 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97415867-edae-4b7b-baaf-01118b127c4e tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:58.702725 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97415867-edae-4b7b-baaf-01118b127c4e tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:58.703164 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97415867-edae-4b7b-baaf-01118b127c4e tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:58.703885 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97415867-edae-4b7b-baaf-01118b127c4e tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:06:58.704343 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97415867-edae-4b7b-baaf-01118b127c4e tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:06:58.704769 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-97415867-edae-4b7b-baaf-01118b127c4e tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:06:58.961287 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-97415867-edae-4b7b-baaf-01118b127c4e tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "POST /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271710 Sep 07 16:06:58.961885 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 522/1027] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Sep 7 16:06:58 2022] POST /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:07:00.532804 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bbd2e028-b625-4722-a494-7caf49185676 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:07:00.535705 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bbd2e028-b625-4722-a494-7caf49185676 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:07:00.542342 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bbd2e028-b625-4722-a494-7caf49185676 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:07:00.542681 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bbd2e028-b625-4722-a494-7caf49185676 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:07:00.543115 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bbd2e028-b625-4722-a494-7caf49185676 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:07:00.543935 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bbd2e028-b625-4722-a494-7caf49185676 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:07:00.544360 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bbd2e028-b625-4722-a494-7caf49185676 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:07:00.544784 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bbd2e028-b625-4722-a494-7caf49185676 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:07:00.572775 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bbd2e028-b625-4722-a494-7caf49185676 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043947 Sep 07 16:07:00.573308 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 506/1028] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Sep 7 16:07:00 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:07:00.637141 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-630744ee-5291-4d5f-853a-461af190f514 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:07:00.637724 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-630744ee-5291-4d5f-853a-461af190f514 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:07:00.644490 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-630744ee-5291-4d5f-853a-461af190f514 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:07:00.644970 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-630744ee-5291-4d5f-853a-461af190f514 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:07:00.645406 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-630744ee-5291-4d5f-853a-461af190f514 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:07:00.646088 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-630744ee-5291-4d5f-853a-461af190f514 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:07:00.646534 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-630744ee-5291-4d5f-853a-461af190f514 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:07:00.646956 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-630744ee-5291-4d5f-853a-461af190f514 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:07:00.671344 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-630744ee-5291-4d5f-853a-461af190f514 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 16:07:00.745118 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-630744ee-5291-4d5f-853a-461af190f514 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "DELETE /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 204 len: 0 microversion: 2.20 time: 0.112355 Sep 07 16:07:00.745785 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 523/1029] 10.222.0.17 () {60 vars in 1280 bytes} [Wed Sep 7 16:07:00 2022] DELETE /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 16:07:00.755279 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-996bb240-97bf-451e-8800-91036a01239e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:07:00.755950 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-996bb240-97bf-451e-8800-91036a01239e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:07:00.761823 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-996bb240-97bf-451e-8800-91036a01239e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:07:00.762298 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-996bb240-97bf-451e-8800-91036a01239e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:07:00.762732 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-996bb240-97bf-451e-8800-91036a01239e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:07:00.763403 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-996bb240-97bf-451e-8800-91036a01239e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:07:00.763879 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-996bb240-97bf-451e-8800-91036a01239e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:07:00.764300 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-996bb240-97bf-451e-8800-91036a01239e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:07:00.895051 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-996bb240-97bf-451e-8800-91036a01239e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:07:00.902977 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-996bb240-97bf-451e-8800-91036a01239e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:07:00.904408 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-996bb240-97bf-451e-8800-91036a01239e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:07:00.905561 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-996bb240-97bf-451e-8800-91036a01239e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1723 microversion: 2.20 time: 0.154885 Sep 07 16:07:00.906111 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 507/1030] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:07:00 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:07:01.931254 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a7c0f731-2d04-4d6c-bd6f-b2b93e08c26b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:07:01.931970 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a7c0f731-2d04-4d6c-bd6f-b2b93e08c26b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:07:01.938451 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a7c0f731-2d04-4d6c-bd6f-b2b93e08c26b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:07:01.938922 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a7c0f731-2d04-4d6c-bd6f-b2b93e08c26b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:07:01.939352 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a7c0f731-2d04-4d6c-bd6f-b2b93e08c26b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:07:01.940053 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a7c0f731-2d04-4d6c-bd6f-b2b93e08c26b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:07:01.940498 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a7c0f731-2d04-4d6c-bd6f-b2b93e08c26b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:07:01.940911 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a7c0f731-2d04-4d6c-bd6f-b2b93e08c26b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:07:02.068761 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a7c0f731-2d04-4d6c-bd6f-b2b93e08c26b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:07:02.076763 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a7c0f731-2d04-4d6c-bd6f-b2b93e08c26b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:07:02.078225 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a7c0f731-2d04-4d6c-bd6f-b2b93e08c26b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:07:02.079384 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a7c0f731-2d04-4d6c-bd6f-b2b93e08c26b tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1723 microversion: 2.20 time: 0.152395 Sep 07 16:07:02.079975 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 524/1031] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:07:01 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:07:03.105906 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8e617ad0-2b6c-4d25-a6ae-5f2327869001 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:07:03.106618 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8e617ad0-2b6c-4d25-a6ae-5f2327869001 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:07:03.113822 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8e617ad0-2b6c-4d25-a6ae-5f2327869001 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:07:03.114309 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8e617ad0-2b6c-4d25-a6ae-5f2327869001 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:07:03.114747 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8e617ad0-2b6c-4d25-a6ae-5f2327869001 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:07:03.115438 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8e617ad0-2b6c-4d25-a6ae-5f2327869001 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:07:03.115923 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8e617ad0-2b6c-4d25-a6ae-5f2327869001 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:07:03.116351 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8e617ad0-2b6c-4d25-a6ae-5f2327869001 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:07:03.197643 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-8e617ad0-2b6c-4d25-a6ae-5f2327869001 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:07:03.206116 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-8e617ad0-2b6c-4d25-a6ae-5f2327869001 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:07:03.208268 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-8e617ad0-2b6c-4d25-a6ae-5f2327869001 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7e96593e2814e8b9f7c0f320aa17c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aae5509a124aebbb92ff5dc82e90cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:07:03.209139 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8e617ad0-2b6c-4d25-a6ae-5f2327869001 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 200 len: 1656 microversion: 2.20 time: 0.107136 Sep 07 16:07:03.216398 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 508/1032] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:07:03 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 1656 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 16:07:03.271255 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-4efe2337-1765-412b-922a-b78ca008c51a req-55bec2e7-3a19-48bf-8d86-fd538beffc39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08697d07-9370-4fcc-aa5b-d10000a4746f", "name": "network-vif-deleted", "tag": "08aa359d-08f5-45a8-976a-77fc0471bfe3"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:07:03.282772 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-4efe2337-1765-412b-922a-b78ca008c51a req-55bec2e7-3a19-48bf-8d86-fd538beffc39 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:07:03.283973 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-4efe2337-1765-412b-922a-b78ca008c51a req-55bec2e7-3a19-48bf-8d86-fd538beffc39 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:07:03.284407 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-4efe2337-1765-412b-922a-b78ca008c51a req-55bec2e7-3a19-48bf-8d86-fd538beffc39 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:07:03.296488 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-4efe2337-1765-412b-922a-b78ca008c51a req-55bec2e7-3a19-48bf-8d86-fd538beffc39 service nova] Creating event network-vif-deleted:08aa359d-08f5-45a8-976a-77fc0471bfe3 for instance 08697d07-9370-4fcc-aa5b-d10000a4746f on hv-cinder-85331 Sep 07 16:07:03.301664 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-4efe2337-1765-412b-922a-b78ca008c51a req-55bec2e7-3a19-48bf-8d86-fd538beffc39 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034452 Sep 07 16:07:03.302328 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 525/1033] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:07:04.234643 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f175ce7f-75f1-424a-ad09-93a9c69acf04 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:07:04.235142 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f175ce7f-75f1-424a-ad09-93a9c69acf04 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:07:04.243290 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f175ce7f-75f1-424a-ad09-93a9c69acf04 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:07:04.243821 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f175ce7f-75f1-424a-ad09-93a9c69acf04 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:07:04.244256 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f175ce7f-75f1-424a-ad09-93a9c69acf04 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:07:04.244955 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f175ce7f-75f1-424a-ad09-93a9c69acf04 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:07:04.245412 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f175ce7f-75f1-424a-ad09-93a9c69acf04 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:07:04.245836 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f175ce7f-75f1-424a-ad09-93a9c69acf04 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:07:04.259946 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-f175ce7f-75f1-424a-ad09-93a9c69acf04 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] HTTP exception thrown: Instance 08697d07-9370-4fcc-aa5b-d10000a4746f could not be found. Sep 07 16:07:04.261614 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f175ce7f-75f1-424a-ad09-93a9c69acf04 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Request method failure captured: Sep 07 16:07:04.261614 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f HTTP/1.1 Sep 07 16:07:04.261614 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Accept: application/json Sep 07 16:07:04.261614 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Accept-Encoding: identity Sep 07 16:07:04.261614 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Connection: close Sep 07 16:07:04.261614 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Content-Length: 0 Sep 07 16:07:04.261614 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Content-Type: application/json Sep 07 16:07:04.261614 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Host: 10.222.0.17 Sep 07 16:07:04.261614 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Openstack-System-Scope: None Sep 07 16:07:04.261614 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Sep 07 16:07:04.261614 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjGL8UfSLAYh3IEZRraFk1XOdyqIr7UwYKg_9_Iw_xdmBOqlSOBxjkH3sLXfW5kRdmUqwKY4bP20Qmyjbl0r05taSeKvdqP4-7LJUwJq0Ht5mb8sYMqPGKzDtaihaODIpU7WoRN9oKD7BpMcpzD1953xaq2B7kmJRgPUOo7nDaR3C4TmY Sep 07 16:07:04.261614 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Domain-Id: None Sep 07 16:07:04.261614 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Domain-Name: None Sep 07 16:07:04.261614 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Identity-Status: Confirmed Sep 07 16:07:04.261614 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Is-Admin-Project: True Sep 07 16:07:04.261614 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 16:07:04.261614 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Domain-Id: default Sep 07 16:07:04.261614 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Domain-Name: Default Sep 07 16:07:04.261614 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Id: 64aae5509a124aebbb92ff5dc82e90cf Sep 07 16:07:04.261614 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-744430082 Sep 07 16:07:04.261614 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Role: reader,member Sep 07 16:07:04.261614 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Roles: reader,member Sep 07 16:07:04.263410 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_64aae5509a124aebbb92ff5dc82e90cf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/64aae5509a124aebbb92ff5dc82e90cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/64aae5509a124aebbb92ff5dc82e90cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/64aae5509a124aebbb92ff5dc82e90cf"}]}] Sep 07 16:07:04.263410 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant: tempest-AttachVolumeShelveTestJSON-744430082 Sep 07 16:07:04.263410 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant-Id: 64aae5509a124aebbb92ff5dc82e90cf Sep 07 16:07:04.263410 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-744430082 Sep 07 16:07:04.263410 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User: tempest-AttachVolumeShelveTestJSON-744430082-project Sep 07 16:07:04.263410 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Domain-Id: default Sep 07 16:07:04.263410 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Domain-Name: Default Sep 07 16:07:04.263410 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Id: d7e96593e2814e8b9f7c0f320aa17c3c Sep 07 16:07:04.263410 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Name: tempest-AttachVolumeShelveTestJSON-744430082-project Sep 07 16:07:04.263410 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: method: > Sep 07 16:07:04.263410 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: exception: Instance 08697d07-9370-4fcc-aa5b-d10000a4746f could not be found. Sep 07 16:07:04.263410 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: action_args: {'id': '08697d07-9370-4fcc-aa5b-d10000a4746f'} Sep 07 16:07:04.267777 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 16:07:04.267777 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:07:04.267777 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 16:07:04.267777 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 16:07:04.267777 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 16:07:04.267777 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 16:07:04.267777 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 16:07:04.267777 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 16:07:04.267777 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 16:07:04.267777 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 16:07:04.267777 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08697d07-9370-4fcc-aa5b-d10000a4746f could not be found. Sep 07 16:07:04.267777 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:07:04.267777 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:07:04.267777 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:07:04.267777 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:07:04.267777 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:07:04.267777 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:07:04.267777 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 16:07:04.267777 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 16:07:04.267777 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 16:07:04.270085 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 16:07:04.270085 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 16:07:04.270085 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 16:07:04.270085 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 16:07:04.270085 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 16:07:04.270085 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 16:07:04.270085 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 16:07:04.270085 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08697d07-9370-4fcc-aa5b-d10000a4746f could not be found. Sep 07 16:07:04.270085 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:07:04.270085 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:07:04.270085 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:07:04.270085 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:07:04.270085 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:07:04.270085 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:07:04.270085 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 16:07:04.270085 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 16:07:04.270085 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08697d07-9370-4fcc-aa5b-d10000a4746f could not be found. Sep 07 16:07:04.270085 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:07:04.271705 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f175ce7f-75f1-424a-ad09-93a9c69acf04 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Returning 404 to user: Instance 08697d07-9370-4fcc-aa5b-d10000a4746f could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 16:07:04.271705 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f175ce7f-75f1-424a-ad09-93a9c69acf04 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 404 len: 111 microversion: 2.20 time: 0.032644 Sep 07 16:07:04.271705 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 509/1034] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:07:04 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 16:07:04.278106 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4ba862d3-ec1f-4c65-88e7-d47ea37f1412 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '.version_select at 0x7ff9a5a97d30>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:07:04.298324 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4ba862d3-ec1f-4c65-88e7-d47ea37f1412 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1497019674" status: 204 len: 0 microversion: 2.20 time: 0.028116 Sep 07 16:07:04.303113 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 526/1035] 10.222.0.17 () {60 vars in 1262 bytes} [Wed Sep 7 16:07:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1497019674 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 16:07:06.042243 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-96126973-37af-4989-afa8-467555f4c5a9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:07:06.042720 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-96126973-37af-4989-afa8-467555f4c5a9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:07:06.049613 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-96126973-37af-4989-afa8-467555f4c5a9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:07:06.050093 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-96126973-37af-4989-afa8-467555f4c5a9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:07:06.050520 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-96126973-37af-4989-afa8-467555f4c5a9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:07:06.051199 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-96126973-37af-4989-afa8-467555f4c5a9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:07:06.051675 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-96126973-37af-4989-afa8-467555f4c5a9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:07:06.052096 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-96126973-37af-4989-afa8-467555f4c5a9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:07:06.065124 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-96126973-37af-4989-afa8-467555f4c5a9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] HTTP exception thrown: Instance 08697d07-9370-4fcc-aa5b-d10000a4746f could not be found. Sep 07 16:07:06.066641 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-96126973-37af-4989-afa8-467555f4c5a9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Request method failure captured: Sep 07 16:07:06.066641 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: request: DELETE /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f HTTP/1.1 Sep 07 16:07:06.066641 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Accept: application/json Sep 07 16:07:06.066641 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Accept-Encoding: identity Sep 07 16:07:06.066641 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Connection: close Sep 07 16:07:06.066641 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Content-Length: 0 Sep 07 16:07:06.066641 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Content-Type: application/json Sep 07 16:07:06.066641 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Host: 10.222.0.17 Sep 07 16:07:06.066641 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Openstack-System-Scope: None Sep 07 16:07:06.066641 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Sep 07 16:07:06.066641 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjGL8UfSLAYh3IEZRraFk1XOdyqIr7UwYKg_9_Iw_xdmBOqlSOBxjkH3sLXfW5kRdmUqwKY4bP20Qmyjbl0r05taSeKvdqP4-7LJUwJq0Ht5mb8sYMqPGKzDtaihaODIpU7WoRN9oKD7BpMcpzD1953xaq2B7kmJRgPUOo7nDaR3C4TmY Sep 07 16:07:06.066641 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Domain-Id: None Sep 07 16:07:06.066641 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Domain-Name: None Sep 07 16:07:06.066641 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Identity-Status: Confirmed Sep 07 16:07:06.066641 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Is-Admin-Project: True Sep 07 16:07:06.066641 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 16:07:06.066641 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Domain-Id: default Sep 07 16:07:06.066641 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Domain-Name: Default Sep 07 16:07:06.066641 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Id: 64aae5509a124aebbb92ff5dc82e90cf Sep 07 16:07:06.066641 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-744430082 Sep 07 16:07:06.066641 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Role: reader,member Sep 07 16:07:06.066641 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Roles: reader,member Sep 07 16:07:06.068387 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_64aae5509a124aebbb92ff5dc82e90cf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/64aae5509a124aebbb92ff5dc82e90cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/64aae5509a124aebbb92ff5dc82e90cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/64aae5509a124aebbb92ff5dc82e90cf"}]}] Sep 07 16:07:06.068387 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant: tempest-AttachVolumeShelveTestJSON-744430082 Sep 07 16:07:06.068387 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant-Id: 64aae5509a124aebbb92ff5dc82e90cf Sep 07 16:07:06.068387 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-744430082 Sep 07 16:07:06.068387 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User: tempest-AttachVolumeShelveTestJSON-744430082-project Sep 07 16:07:06.068387 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Domain-Id: default Sep 07 16:07:06.068387 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Domain-Name: Default Sep 07 16:07:06.068387 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Id: d7e96593e2814e8b9f7c0f320aa17c3c Sep 07 16:07:06.068387 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Name: tempest-AttachVolumeShelveTestJSON-744430082-project Sep 07 16:07:06.068387 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: method: > Sep 07 16:07:06.068387 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: exception: Instance 08697d07-9370-4fcc-aa5b-d10000a4746f could not be found. Sep 07 16:07:06.068387 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: action_args: {'id': '08697d07-9370-4fcc-aa5b-d10000a4746f'} Sep 07 16:07:06.069199 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 16:07:06.069199 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:07:06.069199 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 16:07:06.069199 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 16:07:06.069199 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 16:07:06.069199 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 16:07:06.069199 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 16:07:06.069199 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 16:07:06.069199 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 16:07:06.069199 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 16:07:06.069199 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08697d07-9370-4fcc-aa5b-d10000a4746f could not be found. Sep 07 16:07:06.069199 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:07:06.069199 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:07:06.069199 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:07:06.069199 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:07:06.069199 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:07:06.069199 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:07:06.069199 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 16:07:06.069199 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 16:07:06.069199 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 16:07:06.070474 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 16:07:06.070474 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 16:07:06.070474 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 16:07:06.070474 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 16:07:06.070474 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 16:07:06.070474 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 16:07:06.070474 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 16:07:06.070474 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 16:07:06.070474 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 16:07:06.070474 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08697d07-9370-4fcc-aa5b-d10000a4746f could not be found. Sep 07 16:07:06.070474 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:07:06.070474 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:07:06.070474 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:07:06.070474 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:07:06.070474 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:07:06.070474 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:07:06.070474 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 16:07:06.070474 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 16:07:06.070474 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08697d07-9370-4fcc-aa5b-d10000a4746f could not be found. Sep 07 16:07:06.070474 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:07:06.071781 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-96126973-37af-4989-afa8-467555f4c5a9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Returning 404 to user: Instance 08697d07-9370-4fcc-aa5b-d10000a4746f could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 16:07:06.071781 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-96126973-37af-4989-afa8-467555f4c5a9 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "DELETE /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 404 len: 111 microversion: 2.20 time: 0.029786 Sep 07 16:07:06.071781 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 510/1036] 10.222.0.17 () {60 vars in 1280 bytes} [Wed Sep 7 16:07:06 2022] DELETE /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 16:07:06.076973 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bcf69302-465d-4c51-bf9d-6fa4a47ad537 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:07:06.077702 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bcf69302-465d-4c51-bf9d-6fa4a47ad537 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 08697d07-9370-4fcc-aa5b-d10000a4746f] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:07:06.085553 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bcf69302-465d-4c51-bf9d-6fa4a47ad537 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:07:06.086092 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bcf69302-465d-4c51-bf9d-6fa4a47ad537 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:07:06.086527 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bcf69302-465d-4c51-bf9d-6fa4a47ad537 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:07:06.087454 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bcf69302-465d-4c51-bf9d-6fa4a47ad537 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:07:06.087932 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bcf69302-465d-4c51-bf9d-6fa4a47ad537 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:07:06.088357 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bcf69302-465d-4c51-bf9d-6fa4a47ad537 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:07:06.103728 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-bcf69302-465d-4c51-bf9d-6fa4a47ad537 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] HTTP exception thrown: Instance 08697d07-9370-4fcc-aa5b-d10000a4746f could not be found. Sep 07 16:07:06.105646 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bcf69302-465d-4c51-bf9d-6fa4a47ad537 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Request method failure captured: Sep 07 16:07:06.105646 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f HTTP/1.1 Sep 07 16:07:06.105646 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept: application/json Sep 07 16:07:06.105646 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Sep 07 16:07:06.105646 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Connection: close Sep 07 16:07:06.105646 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Length: 0 Sep 07 16:07:06.105646 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Type: application/json Sep 07 16:07:06.105646 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Host: 10.222.0.17 Sep 07 16:07:06.105646 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Sep 07 16:07:06.105646 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Sep 07 16:07:06.105646 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjGL8UfSLAYh3IEZRraFk1XOdyqIr7UwYKg_9_Iw_xdmBOqlSOBxjkH3sLXfW5kRdmUqwKY4bP20Qmyjbl0r05taSeKvdqP4-7LJUwJq0Ht5mb8sYMqPGKzDtaihaODIpU7WoRN9oKD7BpMcpzD1953xaq2B7kmJRgPUOo7nDaR3C4TmY Sep 07 16:07:06.105646 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Sep 07 16:07:06.105646 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Sep 07 16:07:06.105646 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Sep 07 16:07:06.105646 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Sep 07 16:07:06.105646 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 16:07:06.105646 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Sep 07 16:07:06.105646 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Sep 07 16:07:06.105646 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Id: 64aae5509a124aebbb92ff5dc82e90cf Sep 07 16:07:06.105646 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-744430082 Sep 07 16:07:06.105646 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Role: reader,member Sep 07 16:07:06.105646 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Roles: reader,member Sep 07 16:07:06.107294 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_64aae5509a124aebbb92ff5dc82e90cf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/64aae5509a124aebbb92ff5dc82e90cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/64aae5509a124aebbb92ff5dc82e90cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/64aae5509a124aebbb92ff5dc82e90cf"}]}] Sep 07 16:07:06.107294 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-AttachVolumeShelveTestJSON-744430082 Sep 07 16:07:06.107294 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Id: 64aae5509a124aebbb92ff5dc82e90cf Sep 07 16:07:06.107294 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-744430082 Sep 07 16:07:06.107294 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User: tempest-AttachVolumeShelveTestJSON-744430082-project Sep 07 16:07:06.107294 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Sep 07 16:07:06.107294 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Sep 07 16:07:06.107294 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Id: d7e96593e2814e8b9f7c0f320aa17c3c Sep 07 16:07:06.107294 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-AttachVolumeShelveTestJSON-744430082-project Sep 07 16:07:06.107294 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: method: > Sep 07 16:07:06.107294 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: exception: Instance 08697d07-9370-4fcc-aa5b-d10000a4746f could not be found. Sep 07 16:07:06.107294 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: action_args: {'id': '08697d07-9370-4fcc-aa5b-d10000a4746f'} Sep 07 16:07:06.108176 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 16:07:06.108176 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:07:06.108176 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 16:07:06.108176 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 16:07:06.108176 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 16:07:06.108176 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 16:07:06.108176 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 16:07:06.108176 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 16:07:06.108176 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 16:07:06.108176 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 16:07:06.108176 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08697d07-9370-4fcc-aa5b-d10000a4746f could not be found. Sep 07 16:07:06.108176 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:07:06.108176 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:07:06.108176 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:07:06.108176 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:07:06.108176 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:07:06.108176 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:07:06.108176 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 16:07:06.108176 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 16:07:06.108176 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 16:07:06.109668 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 16:07:06.109668 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 16:07:06.109668 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 16:07:06.109668 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 16:07:06.109668 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 16:07:06.109668 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 16:07:06.109668 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 16:07:06.109668 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08697d07-9370-4fcc-aa5b-d10000a4746f could not be found. Sep 07 16:07:06.109668 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:07:06.109668 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:07:06.109668 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:07:06.109668 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:07:06.109668 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:07:06.109668 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:07:06.109668 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 16:07:06.109668 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 16:07:06.109668 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08697d07-9370-4fcc-aa5b-d10000a4746f could not be found. Sep 07 16:07:06.109668 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:07:06.111087 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bcf69302-465d-4c51-bf9d-6fa4a47ad537 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Returning 404 to user: Instance 08697d07-9370-4fcc-aa5b-d10000a4746f could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 16:07:06.111087 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bcf69302-465d-4c51-bf9d-6fa4a47ad537 tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f" status: 404 len: 111 microversion: 2.20 time: 0.034417 Sep 07 16:07:06.111087 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 527/1037] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:07:06 2022] GET /compute/v2.1/servers/08697d07-9370-4fcc-aa5b-d10000a4746f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 16:07:06.507528 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9d08769c-27de-4f7e-aaed-cdfc9e3c50f0 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:07:06.510134 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9d08769c-27de-4f7e-aaed-cdfc9e3c50f0 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: dc89b872-7af6-430f-ab73-119715d4cbac] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:07:06.516441 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d08769c-27de-4f7e-aaed-cdfc9e3c50f0 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:07:06.516968 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d08769c-27de-4f7e-aaed-cdfc9e3c50f0 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:07:06.517405 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d08769c-27de-4f7e-aaed-cdfc9e3c50f0 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:07:06.518624 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d08769c-27de-4f7e-aaed-cdfc9e3c50f0 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:07:06.519083 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d08769c-27de-4f7e-aaed-cdfc9e3c50f0 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:07:06.519508 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9d08769c-27de-4f7e-aaed-cdfc9e3c50f0 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:07:06.549480 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9d08769c-27de-4f7e-aaed-cdfc9e3c50f0 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046088 Sep 07 16:07:06.550055 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 511/1038] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Sep 7 16:07:06 2022] GET /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:07:06.687216 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-409434d1-1b0a-47ce-95a1-efa1c4500f6f tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:07:06.687716 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-409434d1-1b0a-47ce-95a1-efa1c4500f6f tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: dc89b872-7af6-430f-ab73-119715d4cbac] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:07:06.694031 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-409434d1-1b0a-47ce-95a1-efa1c4500f6f tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:07:06.694513 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-409434d1-1b0a-47ce-95a1-efa1c4500f6f tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:07:06.694993 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-409434d1-1b0a-47ce-95a1-efa1c4500f6f tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:07:06.695695 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-409434d1-1b0a-47ce-95a1-efa1c4500f6f tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:07:06.696144 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-409434d1-1b0a-47ce-95a1-efa1c4500f6f tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:07:06.696563 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-409434d1-1b0a-47ce-95a1-efa1c4500f6f tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:07:06.724923 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-409434d1-1b0a-47ce-95a1-efa1c4500f6f tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac/os-volume_attachments/9f8bdfa8-2dce-4cf4-a768-e7e82abf132e" status: 200 len: 194 microversion: 2.1 time: 0.041703 Sep 07 16:07:06.725478 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 528/1039] 10.222.0.17 () {58 vars in 1413 bytes} [Wed Sep 7 16:07:06 2022] GET /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac/os-volume_attachments/9f8bdfa8-2dce-4cf4-a768-e7e82abf132e => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:07:06.735648 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6d430a17-14a8-41ff-8ad8-89ebfa27653f tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:07:06.736144 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6d430a17-14a8-41ff-8ad8-89ebfa27653f tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: dc89b872-7af6-430f-ab73-119715d4cbac] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:07:06.741979 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d430a17-14a8-41ff-8ad8-89ebfa27653f tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:07:06.742462 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d430a17-14a8-41ff-8ad8-89ebfa27653f tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:07:06.742897 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d430a17-14a8-41ff-8ad8-89ebfa27653f tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:07:06.743606 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d430a17-14a8-41ff-8ad8-89ebfa27653f tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:07:06.744063 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d430a17-14a8-41ff-8ad8-89ebfa27653f tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:07:06.744486 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6d430a17-14a8-41ff-8ad8-89ebfa27653f tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:07:06.824102 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-6d430a17-14a8-41ff-8ad8-89ebfa27653f tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lazy-loading 'services' on Instance uuid dc89b872-7af6-430f-ab73-119715d4cbac {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 16:07:06.894286 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6d430a17-14a8-41ff-8ad8-89ebfa27653f tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "DELETE /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac/os-volume_attachments/9f8bdfa8-2dce-4cf4-a768-e7e82abf132e" status: 202 len: 0 microversion: 2.1 time: 0.162389 Sep 07 16:07:06.894909 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 512/1040] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Sep 7 16:07:06 2022] DELETE /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac/os-volume_attachments/9f8bdfa8-2dce-4cf4-a768-e7e82abf132e => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 16:07:07.256058 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5d9901d6-a777-4bba-865d-ab1fec8b5dca tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:07:07.256556 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5d9901d6-a777-4bba-865d-ab1fec8b5dca tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:07:07.263360 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5d9901d6-a777-4bba-865d-ab1fec8b5dca tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:07:07.263874 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5d9901d6-a777-4bba-865d-ab1fec8b5dca tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:07:07.264304 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5d9901d6-a777-4bba-865d-ab1fec8b5dca tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:07:07.264978 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5d9901d6-a777-4bba-865d-ab1fec8b5dca tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:07:07.265423 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5d9901d6-a777-4bba-865d-ab1fec8b5dca tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:07:07.265837 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5d9901d6-a777-4bba-865d-ab1fec8b5dca tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:07:07.280727 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-5d9901d6-a777-4bba-865d-ab1fec8b5dca tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] HTTP exception thrown: Instance 331c4dfb-7ee1-4585-bed9-2e65fa1f062a could not be found. Sep 07 16:07:07.282320 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5d9901d6-a777-4bba-865d-ab1fec8b5dca tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Request method failure captured: Sep 07 16:07:07.282320 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: request: DELETE /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a HTTP/1.1 Sep 07 16:07:07.282320 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept: application/json Sep 07 16:07:07.282320 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Sep 07 16:07:07.282320 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Connection: close Sep 07 16:07:07.282320 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Length: 0 Sep 07 16:07:07.282320 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Type: application/json Sep 07 16:07:07.282320 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Host: 10.222.0.17 Sep 07 16:07:07.282320 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Sep 07 16:07:07.282320 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Sep 07 16:07:07.282320 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjGL8UfSLAYh3IEZRraFk1XOdyqIr7UwYKg_9_Iw_xdmBOqlSOBxjkH3sLXfW5kRdmUqwKY4bP20Qmyjbl0r05taSeKvdqP4-7LJUwJq0Ht5mb8sYMqPGKzDtaihaODIpU7WoRN9oKD7BpMcpzD1953xaq2B7kmJRgPUOo7nDaR3C4TmY Sep 07 16:07:07.282320 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Sep 07 16:07:07.282320 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Sep 07 16:07:07.282320 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Sep 07 16:07:07.282320 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Sep 07 16:07:07.282320 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 16:07:07.282320 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Sep 07 16:07:07.282320 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Sep 07 16:07:07.282320 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Id: 64aae5509a124aebbb92ff5dc82e90cf Sep 07 16:07:07.282320 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-744430082 Sep 07 16:07:07.282320 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Role: reader,member Sep 07 16:07:07.282320 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Roles: reader,member Sep 07 16:07:07.283896 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_64aae5509a124aebbb92ff5dc82e90cf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/64aae5509a124aebbb92ff5dc82e90cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/64aae5509a124aebbb92ff5dc82e90cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/64aae5509a124aebbb92ff5dc82e90cf"}]}] Sep 07 16:07:07.283896 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-AttachVolumeShelveTestJSON-744430082 Sep 07 16:07:07.283896 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Id: 64aae5509a124aebbb92ff5dc82e90cf Sep 07 16:07:07.283896 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-744430082 Sep 07 16:07:07.283896 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User: tempest-AttachVolumeShelveTestJSON-744430082-project Sep 07 16:07:07.283896 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Sep 07 16:07:07.283896 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Sep 07 16:07:07.283896 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Id: d7e96593e2814e8b9f7c0f320aa17c3c Sep 07 16:07:07.283896 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-AttachVolumeShelveTestJSON-744430082-project Sep 07 16:07:07.283896 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: method: > Sep 07 16:07:07.283896 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: exception: Instance 331c4dfb-7ee1-4585-bed9-2e65fa1f062a could not be found. Sep 07 16:07:07.283896 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: action_args: {'id': '331c4dfb-7ee1-4585-bed9-2e65fa1f062a'} Sep 07 16:07:07.284656 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 16:07:07.284656 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:07:07.284656 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 16:07:07.284656 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 16:07:07.284656 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 16:07:07.284656 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 16:07:07.284656 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 16:07:07.284656 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 16:07:07.284656 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 16:07:07.284656 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 16:07:07.284656 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 331c4dfb-7ee1-4585-bed9-2e65fa1f062a could not be found. Sep 07 16:07:07.284656 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:07:07.284656 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:07:07.284656 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:07:07.284656 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:07:07.284656 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:07:07.284656 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:07:07.284656 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 16:07:07.284656 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 16:07:07.284656 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 16:07:07.285921 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 16:07:07.285921 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 16:07:07.285921 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 16:07:07.285921 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 16:07:07.285921 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 16:07:07.285921 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 16:07:07.285921 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 16:07:07.285921 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 16:07:07.285921 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 16:07:07.285921 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 331c4dfb-7ee1-4585-bed9-2e65fa1f062a could not be found. Sep 07 16:07:07.285921 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:07:07.285921 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:07:07.285921 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:07:07.285921 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:07:07.285921 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:07:07.285921 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:07:07.285921 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 16:07:07.285921 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 16:07:07.285921 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 331c4dfb-7ee1-4585-bed9-2e65fa1f062a could not be found. Sep 07 16:07:07.285921 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:07:07.287163 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5d9901d6-a777-4bba-865d-ab1fec8b5dca tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Returning 404 to user: Instance 331c4dfb-7ee1-4585-bed9-2e65fa1f062a could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 16:07:07.287163 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5d9901d6-a777-4bba-865d-ab1fec8b5dca tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "DELETE /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 404 len: 111 microversion: 2.20 time: 0.032358 Sep 07 16:07:07.287163 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 529/1041] 10.222.0.17 () {60 vars in 1280 bytes} [Wed Sep 7 16:07:07 2022] DELETE /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 16:07:07.292867 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b7ea5caf-07de-4fc1-91ef-b91658d9354e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:07:07.293560 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b7ea5caf-07de-4fc1-91ef-b91658d9354e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] [instance: 331c4dfb-7ee1-4585-bed9-2e65fa1f062a] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:07:07.300975 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7ea5caf-07de-4fc1-91ef-b91658d9354e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:07:07.301451 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7ea5caf-07de-4fc1-91ef-b91658d9354e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:07:07.301878 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7ea5caf-07de-4fc1-91ef-b91658d9354e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:07:07.302557 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7ea5caf-07de-4fc1-91ef-b91658d9354e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:07:07.303152 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7ea5caf-07de-4fc1-91ef-b91658d9354e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:07:07.303592 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7ea5caf-07de-4fc1-91ef-b91658d9354e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:07:07.319086 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-b7ea5caf-07de-4fc1-91ef-b91658d9354e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] HTTP exception thrown: Instance 331c4dfb-7ee1-4585-bed9-2e65fa1f062a could not be found. Sep 07 16:07:07.320735 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b7ea5caf-07de-4fc1-91ef-b91658d9354e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Request method failure captured: Sep 07 16:07:07.320735 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a HTTP/1.1 Sep 07 16:07:07.320735 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Accept: application/json Sep 07 16:07:07.320735 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Accept-Encoding: identity Sep 07 16:07:07.320735 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Connection: close Sep 07 16:07:07.320735 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Content-Length: 0 Sep 07 16:07:07.320735 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Content-Type: application/json Sep 07 16:07:07.320735 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Host: 10.222.0.17 Sep 07 16:07:07.320735 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Openstack-System-Scope: None Sep 07 16:07:07.320735 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Sep 07 16:07:07.320735 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjGL8UfSLAYh3IEZRraFk1XOdyqIr7UwYKg_9_Iw_xdmBOqlSOBxjkH3sLXfW5kRdmUqwKY4bP20Qmyjbl0r05taSeKvdqP4-7LJUwJq0Ht5mb8sYMqPGKzDtaihaODIpU7WoRN9oKD7BpMcpzD1953xaq2B7kmJRgPUOo7nDaR3C4TmY Sep 07 16:07:07.320735 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Domain-Id: None Sep 07 16:07:07.320735 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Domain-Name: None Sep 07 16:07:07.320735 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Identity-Status: Confirmed Sep 07 16:07:07.320735 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Is-Admin-Project: True Sep 07 16:07:07.320735 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 16:07:07.320735 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Domain-Id: default Sep 07 16:07:07.320735 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Domain-Name: Default Sep 07 16:07:07.320735 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Id: 64aae5509a124aebbb92ff5dc82e90cf Sep 07 16:07:07.320735 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-744430082 Sep 07 16:07:07.320735 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Role: reader,member Sep 07 16:07:07.320735 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Roles: reader,member Sep 07 16:07:07.322295 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_64aae5509a124aebbb92ff5dc82e90cf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/64aae5509a124aebbb92ff5dc82e90cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/64aae5509a124aebbb92ff5dc82e90cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/64aae5509a124aebbb92ff5dc82e90cf"}]}] Sep 07 16:07:07.322295 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant: tempest-AttachVolumeShelveTestJSON-744430082 Sep 07 16:07:07.322295 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant-Id: 64aae5509a124aebbb92ff5dc82e90cf Sep 07 16:07:07.322295 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-744430082 Sep 07 16:07:07.322295 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User: tempest-AttachVolumeShelveTestJSON-744430082-project Sep 07 16:07:07.322295 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Domain-Id: default Sep 07 16:07:07.322295 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Domain-Name: Default Sep 07 16:07:07.322295 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Id: d7e96593e2814e8b9f7c0f320aa17c3c Sep 07 16:07:07.322295 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Name: tempest-AttachVolumeShelveTestJSON-744430082-project Sep 07 16:07:07.322295 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: method: > Sep 07 16:07:07.322295 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: exception: Instance 331c4dfb-7ee1-4585-bed9-2e65fa1f062a could not be found. Sep 07 16:07:07.322295 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: action_args: {'id': '331c4dfb-7ee1-4585-bed9-2e65fa1f062a'} Sep 07 16:07:07.323068 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 16:07:07.323068 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:07:07.323068 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 16:07:07.323068 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 16:07:07.323068 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 16:07:07.323068 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 16:07:07.323068 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 16:07:07.323068 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 16:07:07.323068 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 16:07:07.323068 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 16:07:07.323068 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 331c4dfb-7ee1-4585-bed9-2e65fa1f062a could not be found. Sep 07 16:07:07.323068 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:07:07.323068 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:07:07.323068 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:07:07.323068 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:07:07.323068 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:07:07.323068 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:07:07.323068 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 16:07:07.323068 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 16:07:07.323068 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 16:07:07.324344 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 16:07:07.324344 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 16:07:07.324344 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 16:07:07.324344 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 16:07:07.324344 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 16:07:07.324344 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 16:07:07.324344 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 16:07:07.324344 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 331c4dfb-7ee1-4585-bed9-2e65fa1f062a could not be found. Sep 07 16:07:07.324344 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:07:07.324344 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:07:07.324344 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:07:07.324344 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:07:07.324344 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:07:07.324344 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:07:07.324344 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 16:07:07.324344 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 16:07:07.324344 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 331c4dfb-7ee1-4585-bed9-2e65fa1f062a could not be found. Sep 07 16:07:07.324344 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:07:07.325460 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b7ea5caf-07de-4fc1-91ef-b91658d9354e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] Returning 404 to user: Instance 331c4dfb-7ee1-4585-bed9-2e65fa1f062a could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 16:07:07.325460 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b7ea5caf-07de-4fc1-91ef-b91658d9354e tempest-AttachVolumeShelveTestJSON-744430082 tempest-AttachVolumeShelveTestJSON-744430082-project] 10.222.0.17 "GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a" status: 404 len: 111 microversion: 2.20 time: 0.033613 Sep 07 16:07:07.331831 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 513/1042] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Sep 7 16:07:07 2022] GET /compute/v2.1/servers/331c4dfb-7ee1-4585-bed9-2e65fa1f062a => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 16:07:09.083447 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-80a1ec67-f6d7-41f3-a62a-e45086788732 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:07:09.084267 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-80a1ec67-f6d7-41f3-a62a-e45086788732 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: dc89b872-7af6-430f-ab73-119715d4cbac] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:07:09.091072 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80a1ec67-f6d7-41f3-a62a-e45086788732 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:07:09.091906 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80a1ec67-f6d7-41f3-a62a-e45086788732 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:07:09.092418 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80a1ec67-f6d7-41f3-a62a-e45086788732 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:07:09.093470 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80a1ec67-f6d7-41f3-a62a-e45086788732 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:07:09.094040 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80a1ec67-f6d7-41f3-a62a-e45086788732 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:07:09.094679 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-80a1ec67-f6d7-41f3-a62a-e45086788732 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:07:09.125142 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-80a1ec67-f6d7-41f3-a62a-e45086788732 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac/os-volume_attachments/55ca46be-5ee2-4fb8-b845-abd63dd4c21c" status: 200 len: 194 microversion: 2.1 time: 0.045654 Sep 07 16:07:09.125724 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 530/1043] 10.222.0.17 () {58 vars in 1413 bytes} [Wed Sep 7 16:07:09 2022] GET /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac/os-volume_attachments/55ca46be-5ee2-4fb8-b845-abd63dd4c21c => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:07:09.138410 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c4670af9-d5d1-4a79-befc-0ebc6d1f9d75 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:07:09.139790 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c4670af9-d5d1-4a79-befc-0ebc6d1f9d75 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: dc89b872-7af6-430f-ab73-119715d4cbac] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:07:09.148046 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c4670af9-d5d1-4a79-befc-0ebc6d1f9d75 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:07:09.148541 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c4670af9-d5d1-4a79-befc-0ebc6d1f9d75 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:07:09.148983 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c4670af9-d5d1-4a79-befc-0ebc6d1f9d75 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:07:09.149679 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c4670af9-d5d1-4a79-befc-0ebc6d1f9d75 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:07:09.150140 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c4670af9-d5d1-4a79-befc-0ebc6d1f9d75 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:07:09.150564 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c4670af9-d5d1-4a79-befc-0ebc6d1f9d75 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:07:09.246892 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-c4670af9-d5d1-4a79-befc-0ebc6d1f9d75 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lazy-loading 'services' on Instance uuid dc89b872-7af6-430f-ab73-119715d4cbac {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 16:07:09.332552 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c4670af9-d5d1-4a79-befc-0ebc6d1f9d75 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "DELETE /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac/os-volume_attachments/55ca46be-5ee2-4fb8-b845-abd63dd4c21c" status: 202 len: 0 microversion: 2.1 time: 0.199595 Sep 07 16:07:09.333188 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 514/1044] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Sep 7 16:07:09 2022] DELETE /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac/os-volume_attachments/55ca46be-5ee2-4fb8-b845-abd63dd4c21c => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 16:07:10.529790 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4b6fd6a4-46e2-4800-8dca-c09b9a95eb88 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:07:10.531975 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4b6fd6a4-46e2-4800-8dca-c09b9a95eb88 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: dc89b872-7af6-430f-ab73-119715d4cbac] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:07:10.539932 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b6fd6a4-46e2-4800-8dca-c09b9a95eb88 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:07:10.540463 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b6fd6a4-46e2-4800-8dca-c09b9a95eb88 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:07:10.540897 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b6fd6a4-46e2-4800-8dca-c09b9a95eb88 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:07:10.541636 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b6fd6a4-46e2-4800-8dca-c09b9a95eb88 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:07:10.542086 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b6fd6a4-46e2-4800-8dca-c09b9a95eb88 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:07:10.542526 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b6fd6a4-46e2-4800-8dca-c09b9a95eb88 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:07:10.574099 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4b6fd6a4-46e2-4800-8dca-c09b9a95eb88 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048041 Sep 07 16:07:10.580280 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 531/1045] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Sep 7 16:07:10 2022] GET /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 16:07:10.702075 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ad5f9448-85d6-4d7d-9b5a-1d8564d9fa99 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:07:10.704908 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ad5f9448-85d6-4d7d-9b5a-1d8564d9fa99 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: dc89b872-7af6-430f-ab73-119715d4cbac] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:07:10.711362 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad5f9448-85d6-4d7d-9b5a-1d8564d9fa99 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:07:10.711942 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad5f9448-85d6-4d7d-9b5a-1d8564d9fa99 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:07:10.712301 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad5f9448-85d6-4d7d-9b5a-1d8564d9fa99 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:07:10.712989 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad5f9448-85d6-4d7d-9b5a-1d8564d9fa99 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:07:10.713443 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad5f9448-85d6-4d7d-9b5a-1d8564d9fa99 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:07:10.713919 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ad5f9448-85d6-4d7d-9b5a-1d8564d9fa99 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:07:10.747204 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ad5f9448-85d6-4d7d-9b5a-1d8564d9fa99 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051333 Sep 07 16:07:10.748084 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 515/1046] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Sep 7 16:07:10 2022] GET /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 16:07:10.812966 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8ec239a1-c67a-4891-abf1-819a1c7bc7a2 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:07:10.813461 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8ec239a1-c67a-4891-abf1-819a1c7bc7a2 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: dc89b872-7af6-430f-ab73-119715d4cbac] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:07:10.819441 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ec239a1-c67a-4891-abf1-819a1c7bc7a2 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:07:10.819948 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ec239a1-c67a-4891-abf1-819a1c7bc7a2 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:07:10.820374 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ec239a1-c67a-4891-abf1-819a1c7bc7a2 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:07:10.821048 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ec239a1-c67a-4891-abf1-819a1c7bc7a2 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:07:10.821498 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ec239a1-c67a-4891-abf1-819a1c7bc7a2 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:07:10.822044 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8ec239a1-c67a-4891-abf1-819a1c7bc7a2 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:07:10.848531 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8ec239a1-c67a-4891-abf1-819a1c7bc7a2 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: dc89b872-7af6-430f-ab73-119715d4cbac] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 16:07:10.925041 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8ec239a1-c67a-4891-abf1-819a1c7bc7a2 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "DELETE /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac" status: 204 len: 0 microversion: 2.1 time: 0.115719 Sep 07 16:07:10.925719 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 532/1047] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Sep 7 16:07:10 2022] DELETE /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 16:07:10.939632 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c95756de-d31b-4d0e-90a1-ceddc8d8cf6b tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:07:10.940245 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c95756de-d31b-4d0e-90a1-ceddc8d8cf6b tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: dc89b872-7af6-430f-ab73-119715d4cbac] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:07:10.946124 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c95756de-d31b-4d0e-90a1-ceddc8d8cf6b tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:07:10.946598 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c95756de-d31b-4d0e-90a1-ceddc8d8cf6b tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:07:10.947034 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c95756de-d31b-4d0e-90a1-ceddc8d8cf6b tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:07:10.947723 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c95756de-d31b-4d0e-90a1-ceddc8d8cf6b tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:07:10.948173 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c95756de-d31b-4d0e-90a1-ceddc8d8cf6b tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:07:10.948590 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c95756de-d31b-4d0e-90a1-ceddc8d8cf6b tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:07:11.094117 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-c95756de-d31b-4d0e-90a1-ceddc8d8cf6b tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:07:11.103902 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c95756de-d31b-4d0e-90a1-ceddc8d8cf6b tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac" status: 200 len: 1674 microversion: 2.1 time: 0.170681 Sep 07 16:07:11.104472 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 516/1048] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:07:10 2022] GET /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac => generated 1674 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:07:12.127725 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7cdd9c6a-77ab-4ea6-95db-4d4bd9612b7e tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:07:12.128355 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7cdd9c6a-77ab-4ea6-95db-4d4bd9612b7e tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: dc89b872-7af6-430f-ab73-119715d4cbac] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:07:12.134741 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7cdd9c6a-77ab-4ea6-95db-4d4bd9612b7e tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:07:12.135222 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7cdd9c6a-77ab-4ea6-95db-4d4bd9612b7e tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:07:12.135700 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7cdd9c6a-77ab-4ea6-95db-4d4bd9612b7e tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:07:12.136390 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7cdd9c6a-77ab-4ea6-95db-4d4bd9612b7e tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:07:12.136843 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7cdd9c6a-77ab-4ea6-95db-4d4bd9612b7e tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:07:12.137270 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7cdd9c6a-77ab-4ea6-95db-4d4bd9612b7e tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:07:12.274871 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7cdd9c6a-77ab-4ea6-95db-4d4bd9612b7e tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:07:12.283648 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7cdd9c6a-77ab-4ea6-95db-4d4bd9612b7e tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac" status: 200 len: 1674 microversion: 2.1 time: 0.160137 Sep 07 16:07:12.284224 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 533/1049] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:07:12 2022] GET /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:07:12.856911 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9074a97f-f140-4866-a2a0-0ab3f2c0f314 tempest-VolumesTestJSON-2133764702 tempest-VolumesTestJSON-2133764702-project] Calling method '.version_select at 0x7ff9a5eb3af0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:07:12.903766 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9074a97f-f140-4866-a2a0-0ab3f2c0f314 tempest-VolumesTestJSON-2133764702 tempest-VolumesTestJSON-2133764702-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/17371d09-edba-4a97-a583-a3ff43c1fd43" status: 200 len: 351 microversion: 2.1 time: 0.050548 Sep 07 16:07:12.904322 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 517/1050] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Sep 7 16:07:12 2022] GET /compute/v2.1/os-volumes/17371d09-edba-4a97-a583-a3ff43c1fd43 => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:07:13.306743 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-19075638-61a4-44b1-8d53-6c573c693af8 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:07:13.307334 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-19075638-61a4-44b1-8d53-6c573c693af8 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: dc89b872-7af6-430f-ab73-119715d4cbac] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:07:13.313917 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19075638-61a4-44b1-8d53-6c573c693af8 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:07:13.314342 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19075638-61a4-44b1-8d53-6c573c693af8 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:07:13.314776 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19075638-61a4-44b1-8d53-6c573c693af8 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:07:13.315475 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19075638-61a4-44b1-8d53-6c573c693af8 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:07:13.316536 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19075638-61a4-44b1-8d53-6c573c693af8 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:07:13.316966 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19075638-61a4-44b1-8d53-6c573c693af8 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:07:13.451700 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-19075638-61a4-44b1-8d53-6c573c693af8 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:07:13.459387 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-19075638-61a4-44b1-8d53-6c573c693af8 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac" status: 200 len: 1674 microversion: 2.1 time: 0.156498 Sep 07 16:07:13.459968 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 534/1051] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:07:13 2022] GET /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:07:13.992156 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-b8d49431-e730-40e6-909b-c45a532988c4 req-992b5dae-5d53-47c7-ad1f-83fd1b84364b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc89b872-7af6-430f-ab73-119715d4cbac", "name": "network-vif-deleted", "tag": "4f0e45df-784a-4abe-9908-b3f4ca882014"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:07:14.004884 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-b8d49431-e730-40e6-909b-c45a532988c4 req-992b5dae-5d53-47c7-ad1f-83fd1b84364b service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:07:14.005374 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-b8d49431-e730-40e6-909b-c45a532988c4 req-992b5dae-5d53-47c7-ad1f-83fd1b84364b service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:07:14.005811 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-b8d49431-e730-40e6-909b-c45a532988c4 req-992b5dae-5d53-47c7-ad1f-83fd1b84364b service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:07:14.017466 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-b8d49431-e730-40e6-909b-c45a532988c4 req-992b5dae-5d53-47c7-ad1f-83fd1b84364b service nova] Creating event network-vif-deleted:4f0e45df-784a-4abe-9908-b3f4ca882014 for instance dc89b872-7af6-430f-ab73-119715d4cbac on hv-cinder-85331 Sep 07 16:07:14.024138 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-b8d49431-e730-40e6-909b-c45a532988c4 req-992b5dae-5d53-47c7-ad1f-83fd1b84364b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037815 Sep 07 16:07:14.024838 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 518/1052] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 16:07:14.247869 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-29c774ae-84b8-4e5a-9185-a7b7d41d4d51 tempest-VolumesTestJSON-2133764702 tempest-VolumesTestJSON-2133764702-project] Calling method '.version_select at 0x7ff9a5c30ca0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:07:14.299426 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-29c774ae-84b8-4e5a-9185-a7b7d41d4d51 tempest-VolumesTestJSON-2133764702 tempest-VolumesTestJSON-2133764702-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/88a862bb-9cd0-48e6-9cc8-cb720b3f6177" status: 200 len: 351 microversion: 2.1 time: 0.055262 Sep 07 16:07:14.300198 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 535/1053] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Sep 7 16:07:14 2022] GET /compute/v2.1/os-volumes/88a862bb-9cd0-48e6-9cc8-cb720b3f6177 => generated 351 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:07:14.484181 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9c5d816e-0909-45a2-b0a1-1e1ab132e887 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:07:14.485176 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9c5d816e-0909-45a2-b0a1-1e1ab132e887 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: dc89b872-7af6-430f-ab73-119715d4cbac] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:07:14.491935 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c5d816e-0909-45a2-b0a1-1e1ab132e887 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:07:14.492427 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c5d816e-0909-45a2-b0a1-1e1ab132e887 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:07:14.492863 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c5d816e-0909-45a2-b0a1-1e1ab132e887 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:07:14.493555 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c5d816e-0909-45a2-b0a1-1e1ab132e887 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:07:14.494009 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c5d816e-0909-45a2-b0a1-1e1ab132e887 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:07:14.494603 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c5d816e-0909-45a2-b0a1-1e1ab132e887 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:07:14.527296 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c5d816e-0909-45a2-b0a1-1e1ab132e887 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:07:14.527823 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c5d816e-0909-45a2-b0a1-1e1ab132e887 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:07:14.528259 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9c5d816e-0909-45a2-b0a1-1e1ab132e887 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:07:14.528897 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-9c5d816e-0909-45a2-b0a1-1e1ab132e887 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lazy-loading 'fault' on Instance uuid dc89b872-7af6-430f-ab73-119715d4cbac {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 16:07:14.580096 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-9c5d816e-0909-45a2-b0a1-1e1ab132e887 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fcfbaf5bab14a4783ca912a222341c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446dbd47db84c4987a3ee5332356b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:07:14.603806 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9c5d816e-0909-45a2-b0a1-1e1ab132e887 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac" status: 200 len: 1328 microversion: 2.1 time: 0.124010 Sep 07 16:07:14.604396 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 519/1054] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:07:14 2022] GET /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac => generated 1328 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:07:15.627377 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7e2660f7-8aa7-4c1f-a5fc-b572a0eeb00f tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:07:15.628530 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7e2660f7-8aa7-4c1f-a5fc-b572a0eeb00f tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: dc89b872-7af6-430f-ab73-119715d4cbac] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:07:15.635245 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e2660f7-8aa7-4c1f-a5fc-b572a0eeb00f tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:07:15.635783 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e2660f7-8aa7-4c1f-a5fc-b572a0eeb00f tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:07:15.636226 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e2660f7-8aa7-4c1f-a5fc-b572a0eeb00f tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:07:15.636945 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e2660f7-8aa7-4c1f-a5fc-b572a0eeb00f tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:07:15.637400 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e2660f7-8aa7-4c1f-a5fc-b572a0eeb00f tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:07:15.637827 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7e2660f7-8aa7-4c1f-a5fc-b572a0eeb00f tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:07:15.643416 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:07:15.654751 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-7e2660f7-8aa7-4c1f-a5fc-b572a0eeb00f tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] HTTP exception thrown: Instance dc89b872-7af6-430f-ab73-119715d4cbac could not be found. Sep 07 16:07:15.656608 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7e2660f7-8aa7-4c1f-a5fc-b572a0eeb00f tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Request method failure captured: Sep 07 16:07:15.656608 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac HTTP/1.1 Sep 07 16:07:15.656608 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept: application/json Sep 07 16:07:15.656608 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Sep 07 16:07:15.656608 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Connection: close Sep 07 16:07:15.656608 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Length: 0 Sep 07 16:07:15.656608 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Type: application/json Sep 07 16:07:15.656608 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Host: 10.222.0.17 Sep 07 16:07:15.656608 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Sep 07 16:07:15.656608 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Sep 07 16:07:15.656608 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjGL-dAAjtQX0BBXg33LYFvaSUKZB2bRbxMUhHSHg00Fvmow_9lu17BLkz1nJJgHoEEvSo9hsLiYfdxAGFpdgpu_DK1O22QaIqj2pcyAjUKkETT2aPl97blUlEndVWe7u0yPav2HWLaLZ_Ls49JGwXa24vQHSKAQ5iMrT_eJl8dfvq_Ps Sep 07 16:07:15.656608 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Sep 07 16:07:15.656608 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Sep 07 16:07:15.656608 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Sep 07 16:07:15.656608 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Sep 07 16:07:15.656608 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Sep 07 16:07:15.656608 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Sep 07 16:07:15.656608 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Id: a446dbd47db84c4987a3ee5332356b84 Sep 07 16:07:15.656608 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-AttachVolumeTestJSON-1368644544 Sep 07 16:07:15.656608 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Role: reader,member Sep 07 16:07:15.656608 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Roles: reader,member Sep 07 16:07:15.658300 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a446dbd47db84c4987a3ee5332356b84", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a446dbd47db84c4987a3ee5332356b84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a446dbd47db84c4987a3ee5332356b84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a446dbd47db84c4987a3ee5332356b84"}]}] Sep 07 16:07:15.658300 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-AttachVolumeTestJSON-1368644544 Sep 07 16:07:15.658300 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Id: a446dbd47db84c4987a3ee5332356b84 Sep 07 16:07:15.658300 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1368644544 Sep 07 16:07:15.658300 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User: tempest-AttachVolumeTestJSON-1368644544-project Sep 07 16:07:15.658300 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Sep 07 16:07:15.658300 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Sep 07 16:07:15.658300 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Id: 2fcfbaf5bab14a4783ca912a222341c0 Sep 07 16:07:15.658300 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-AttachVolumeTestJSON-1368644544-project Sep 07 16:07:15.658300 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: method: > Sep 07 16:07:15.658300 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: exception: Instance dc89b872-7af6-430f-ab73-119715d4cbac could not be found. Sep 07 16:07:15.658300 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: action_args: {'id': 'dc89b872-7af6-430f-ab73-119715d4cbac'} Sep 07 16:07:15.659154 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 16:07:15.659154 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:07:15.659154 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 16:07:15.659154 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 16:07:15.659154 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 16:07:15.659154 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 16:07:15.659154 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 16:07:15.659154 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 16:07:15.659154 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 16:07:15.659154 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 16:07:15.659154 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc89b872-7af6-430f-ab73-119715d4cbac could not be found. Sep 07 16:07:15.659154 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:07:15.659154 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:07:15.659154 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:07:15.659154 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:07:15.659154 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:07:15.659154 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:07:15.659154 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 16:07:15.659154 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 16:07:15.659154 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 16:07:15.660737 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 16:07:15.660737 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 16:07:15.660737 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 16:07:15.660737 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 16:07:15.660737 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 16:07:15.660737 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 16:07:15.660737 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 16:07:15.660737 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc89b872-7af6-430f-ab73-119715d4cbac could not be found. Sep 07 16:07:15.660737 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:07:15.660737 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:07:15.660737 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:07:15.660737 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:07:15.660737 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:07:15.660737 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:07:15.660737 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 16:07:15.660737 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 16:07:15.660737 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc89b872-7af6-430f-ab73-119715d4cbac could not be found. Sep 07 16:07:15.660737 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:07:15.662154 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7e2660f7-8aa7-4c1f-a5fc-b572a0eeb00f tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Returning 404 to user: Instance dc89b872-7af6-430f-ab73-119715d4cbac could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 16:07:15.662154 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7e2660f7-8aa7-4c1f-a5fc-b572a0eeb00f tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac" status: 404 len: 111 microversion: 2.1 time: 0.035113 Sep 07 16:07:15.662154 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 536/1055] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:07:15 2022] GET /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 16:07:15.667735 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-06588e9d-03d5-4bad-8bd9-6af3c8873a8e tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '.version_select at 0x7ff9a592b550>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:07:15.688505 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-06588e9d-03d5-4bad-8bd9-6af3c8873a8e tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1143841063" status: 202 len: 0 microversion: 2.1 time: 0.024817 Sep 07 16:07:15.689098 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 520/1056] 10.222.0.17 () {58 vars in 1221 bytes} [Wed Sep 7 16:07:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1143841063 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 16:07:15.803300 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-95d3f055-49e3-482d-a65f-d16498481d32 tempest-VolumesTestJSON-2133764702 tempest-VolumesTestJSON-2133764702-project] Calling method '.version_select at 0x7ff9a5b23c10>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:07:15.856667 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-95d3f055-49e3-482d-a65f-d16498481d32 tempest-VolumesTestJSON-2133764702 tempest-VolumesTestJSON-2133764702-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/8d7c9286-2fdd-427b-b3db-1df0cf676deb" status: 200 len: 351 microversion: 2.1 time: 0.057227 Sep 07 16:07:15.857235 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 537/1057] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Sep 7 16:07:15 2022] GET /compute/v2.1/os-volumes/8d7c9286-2fdd-427b-b3db-1df0cf676deb => generated 351 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:07:15.871012 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1820c45b-21ad-4d32-a8d3-e1cc8acc5ca8 tempest-VolumesTestJSON-2133764702 tempest-VolumesTestJSON-2133764702-project] Calling method '.version_select at 0x7ff9a5eae4c0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:07:15.952946 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1820c45b-21ad-4d32-a8d3-e1cc8acc5ca8 tempest-VolumesTestJSON-2133764702 tempest-VolumesTestJSON-2133764702-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.086680 Sep 07 16:07:15.953519 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 521/1058] 10.222.0.17 () {58 vars in 1134 bytes} [Wed Sep 7 16:07:15 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:07:15.968130 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-51f36594-a4ee-4f6c-82d2-23a86ee58335 tempest-VolumesTestJSON-2133764702 tempest-VolumesTestJSON-2133764702-project] Calling method '.version_select at 0x7ff9a5ad8940>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:07:16.054893 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-51f36594-a4ee-4f6c-82d2-23a86ee58335 tempest-VolumesTestJSON-2133764702 tempest-VolumesTestJSON-2133764702-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.090456 Sep 07 16:07:16.055742 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 538/1059] 10.222.0.17 () {58 vars in 1149 bytes} [Wed Sep 7 16:07:15 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:07:16.069571 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-619993c6-4efc-467a-bc9d-14c4972c55a4 tempest-VolumesTestJSON-2133764702 tempest-VolumesTestJSON-2133764702-project] Calling method '.version_select at 0x7ff9a5eaf820>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:07:16.151463 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-619993c6-4efc-467a-bc9d-14c4972c55a4 tempest-VolumesTestJSON-2133764702 tempest-VolumesTestJSON-2133764702-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.086279 Sep 07 16:07:16.152064 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 522/1060] 10.222.0.17 () {58 vars in 1134 bytes} [Wed Sep 7 16:07:16 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:07:16.165215 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-40adf43f-c444-4551-ac20-789e8ebfc00b tempest-VolumesTestJSON-2133764702 tempest-VolumesTestJSON-2133764702-project] Calling method '.version_select at 0x7ff9a5ace670>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:07:16.254050 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-40adf43f-c444-4551-ac20-789e8ebfc00b tempest-VolumesTestJSON-2133764702 tempest-VolumesTestJSON-2133764702-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.091930 Sep 07 16:07:16.254685 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 539/1061] 10.222.0.17 () {58 vars in 1167 bytes} [Wed Sep 7 16:07:16 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:07:16.268157 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b4cacfbf-04a4-4d79-a0da-3a6c99ab4a2d tempest-VolumesTestJSON-2133764702 tempest-VolumesTestJSON-2133764702-project] Calling method '.version_select at 0x7ff9a5d60820>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:07:16.363863 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b4cacfbf-04a4-4d79-a0da-3a6c99ab4a2d tempest-VolumesTestJSON-2133764702 tempest-VolumesTestJSON-2133764702-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.099432 Sep 07 16:07:16.364510 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 523/1062] 10.222.0.17 () {58 vars in 1170 bytes} [Wed Sep 7 16:07:16 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:07:16.379178 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1215d9a6-3ea3-4326-8509-03823db16ce5 tempest-VolumesTestJSON-2133764702 tempest-VolumesTestJSON-2133764702-project] Calling method '.version_select at 0x7ff9a5b23a60>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:07:16.464469 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1215d9a6-3ea3-4326-8509-03823db16ce5 tempest-VolumesTestJSON-2133764702 tempest-VolumesTestJSON-2133764702-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.089831 Sep 07 16:07:16.465112 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 540/1063] 10.222.0.17 () {58 vars in 1155 bytes} [Wed Sep 7 16:07:16 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 16:07:16.480196 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0f6c0c26-b465-4bea-973c-4fc8ff489771 tempest-VolumesTestJSON-2133764702 tempest-VolumesTestJSON-2133764702-project] Calling method '.version_select at 0x7ff9a5e07a60>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:07:16.565141 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0f6c0c26-b465-4bea-973c-4fc8ff489771 tempest-VolumesTestJSON-2133764702 tempest-VolumesTestJSON-2133764702-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.088685 Sep 07 16:07:16.565837 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 524/1064] 10.222.0.17 () {58 vars in 1188 bytes} [Wed Sep 7 16:07:16 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:07:16.578887 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0ce6df78-b318-441e-8759-c13d36e1f7f6 tempest-VolumesTestJSON-2133764702 tempest-VolumesTestJSON-2133764702-project] Calling method '.version_select at 0x7ff9a5c5a670>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:07:16.666754 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0ce6df78-b318-441e-8759-c13d36e1f7f6 tempest-VolumesTestJSON-2133764702 tempest-VolumesTestJSON-2133764702-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.091265 Sep 07 16:07:16.667454 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 541/1065] 10.222.0.17 () {58 vars in 1155 bytes} [Wed Sep 7 16:07:16 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:07:18.852432 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e8099763-3ed9-43d1-924f-e8c1db6f948c tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:07:18.852984 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e8099763-3ed9-43d1-924f-e8c1db6f948c tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: dc89b872-7af6-430f-ab73-119715d4cbac] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:07:18.859559 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e8099763-3ed9-43d1-924f-e8c1db6f948c tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:07:18.860055 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e8099763-3ed9-43d1-924f-e8c1db6f948c tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:07:18.860492 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e8099763-3ed9-43d1-924f-e8c1db6f948c tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:07:18.861173 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e8099763-3ed9-43d1-924f-e8c1db6f948c tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:07:18.861629 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e8099763-3ed9-43d1-924f-e8c1db6f948c tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:07:18.862051 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e8099763-3ed9-43d1-924f-e8c1db6f948c tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:07:18.875532 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-e8099763-3ed9-43d1-924f-e8c1db6f948c tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] HTTP exception thrown: Instance dc89b872-7af6-430f-ab73-119715d4cbac could not be found. Sep 07 16:07:18.877186 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e8099763-3ed9-43d1-924f-e8c1db6f948c tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Request method failure captured: Sep 07 16:07:18.877186 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: request: DELETE /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac HTTP/1.1 Sep 07 16:07:18.877186 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Accept: application/json Sep 07 16:07:18.877186 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Accept-Encoding: identity Sep 07 16:07:18.877186 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Connection: close Sep 07 16:07:18.877186 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Content-Length: 0 Sep 07 16:07:18.877186 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Content-Type: application/json Sep 07 16:07:18.877186 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Host: 10.222.0.17 Sep 07 16:07:18.877186 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Openstack-System-Scope: None Sep 07 16:07:18.877186 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Sep 07 16:07:18.877186 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjGL-dAAjtQX0BBXg33LYFvaSUKZB2bRbxMUhHSHg00Fvmow_9lu17BLkz1nJJgHoEEvSo9hsLiYfdxAGFpdgpu_DK1O22QaIqj2pcyAjUKkETT2aPl97blUlEndVWe7u0yPav2HWLaLZ_Ls49JGwXa24vQHSKAQ5iMrT_eJl8dfvq_Ps Sep 07 16:07:18.877186 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Domain-Id: None Sep 07 16:07:18.877186 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Domain-Name: None Sep 07 16:07:18.877186 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Identity-Status: Confirmed Sep 07 16:07:18.877186 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Is-Admin-Project: True Sep 07 16:07:18.877186 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Domain-Id: default Sep 07 16:07:18.877186 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Domain-Name: Default Sep 07 16:07:18.877186 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Id: a446dbd47db84c4987a3ee5332356b84 Sep 07 16:07:18.877186 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Name: tempest-AttachVolumeTestJSON-1368644544 Sep 07 16:07:18.877186 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Role: reader,member Sep 07 16:07:18.877186 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Roles: reader,member Sep 07 16:07:18.878777 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a446dbd47db84c4987a3ee5332356b84", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a446dbd47db84c4987a3ee5332356b84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a446dbd47db84c4987a3ee5332356b84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a446dbd47db84c4987a3ee5332356b84"}]}] Sep 07 16:07:18.878777 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant: tempest-AttachVolumeTestJSON-1368644544 Sep 07 16:07:18.878777 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant-Id: a446dbd47db84c4987a3ee5332356b84 Sep 07 16:07:18.878777 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1368644544 Sep 07 16:07:18.878777 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User: tempest-AttachVolumeTestJSON-1368644544-project Sep 07 16:07:18.878777 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Domain-Id: default Sep 07 16:07:18.878777 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Domain-Name: Default Sep 07 16:07:18.878777 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Id: 2fcfbaf5bab14a4783ca912a222341c0 Sep 07 16:07:18.878777 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Name: tempest-AttachVolumeTestJSON-1368644544-project Sep 07 16:07:18.878777 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: method: > Sep 07 16:07:18.878777 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: exception: Instance dc89b872-7af6-430f-ab73-119715d4cbac could not be found. Sep 07 16:07:18.878777 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: action_args: {'id': 'dc89b872-7af6-430f-ab73-119715d4cbac'} Sep 07 16:07:18.879785 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 16:07:18.879785 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:07:18.879785 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 16:07:18.879785 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 16:07:18.879785 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 16:07:18.879785 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 16:07:18.879785 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 16:07:18.879785 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 16:07:18.879785 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 16:07:18.879785 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 16:07:18.879785 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc89b872-7af6-430f-ab73-119715d4cbac could not be found. Sep 07 16:07:18.879785 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:07:18.879785 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:07:18.879785 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:07:18.879785 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:07:18.879785 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:07:18.879785 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:07:18.879785 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 16:07:18.879785 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 16:07:18.879785 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 16:07:18.881058 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 16:07:18.881058 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 16:07:18.881058 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 16:07:18.881058 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 16:07:18.881058 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 16:07:18.881058 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 16:07:18.881058 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 16:07:18.881058 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 16:07:18.881058 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 16:07:18.881058 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc89b872-7af6-430f-ab73-119715d4cbac could not be found. Sep 07 16:07:18.881058 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:07:18.881058 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:07:18.881058 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:07:18.881058 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:07:18.881058 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:07:18.881058 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:07:18.881058 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 16:07:18.881058 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 16:07:18.881058 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc89b872-7af6-430f-ab73-119715d4cbac could not be found. Sep 07 16:07:18.881058 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:07:18.882528 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e8099763-3ed9-43d1-924f-e8c1db6f948c tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Returning 404 to user: Instance dc89b872-7af6-430f-ab73-119715d4cbac could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 16:07:18.882528 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e8099763-3ed9-43d1-924f-e8c1db6f948c tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "DELETE /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac" status: 404 len: 111 microversion: 2.1 time: 0.031255 Sep 07 16:07:18.882528 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 525/1066] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Sep 7 16:07:18 2022] DELETE /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 16:07:18.887267 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-706ca20b-6e70-4264-a45c-1b962c278f24 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:07:18.887900 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-706ca20b-6e70-4264-a45c-1b962c278f24 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: dc89b872-7af6-430f-ab73-119715d4cbac] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:07:18.889747 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:07:18.895373 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-706ca20b-6e70-4264-a45c-1b962c278f24 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:07:18.895970 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-706ca20b-6e70-4264-a45c-1b962c278f24 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:07:18.896400 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-706ca20b-6e70-4264-a45c-1b962c278f24 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:07:18.897076 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-706ca20b-6e70-4264-a45c-1b962c278f24 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:07:18.897523 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-706ca20b-6e70-4264-a45c-1b962c278f24 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:07:18.897941 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-706ca20b-6e70-4264-a45c-1b962c278f24 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:07:18.912993 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-706ca20b-6e70-4264-a45c-1b962c278f24 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] HTTP exception thrown: Instance dc89b872-7af6-430f-ab73-119715d4cbac could not be found. Sep 07 16:07:18.914496 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-706ca20b-6e70-4264-a45c-1b962c278f24 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Request method failure captured: Sep 07 16:07:18.914496 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac HTTP/1.1 Sep 07 16:07:18.914496 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept: application/json Sep 07 16:07:18.914496 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Sep 07 16:07:18.914496 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Connection: close Sep 07 16:07:18.914496 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Length: 0 Sep 07 16:07:18.914496 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Type: application/json Sep 07 16:07:18.914496 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Host: 10.222.0.17 Sep 07 16:07:18.914496 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Sep 07 16:07:18.914496 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Sep 07 16:07:18.914496 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjGL-dAAjtQX0BBXg33LYFvaSUKZB2bRbxMUhHSHg00Fvmow_9lu17BLkz1nJJgHoEEvSo9hsLiYfdxAGFpdgpu_DK1O22QaIqj2pcyAjUKkETT2aPl97blUlEndVWe7u0yPav2HWLaLZ_Ls49JGwXa24vQHSKAQ5iMrT_eJl8dfvq_Ps Sep 07 16:07:18.914496 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Sep 07 16:07:18.914496 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Sep 07 16:07:18.914496 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Sep 07 16:07:18.914496 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Sep 07 16:07:18.914496 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Sep 07 16:07:18.914496 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Sep 07 16:07:18.914496 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Id: a446dbd47db84c4987a3ee5332356b84 Sep 07 16:07:18.914496 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-AttachVolumeTestJSON-1368644544 Sep 07 16:07:18.914496 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Role: reader,member Sep 07 16:07:18.914496 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Roles: reader,member Sep 07 16:07:18.916185 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a446dbd47db84c4987a3ee5332356b84", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a446dbd47db84c4987a3ee5332356b84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a446dbd47db84c4987a3ee5332356b84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a446dbd47db84c4987a3ee5332356b84"}]}] Sep 07 16:07:18.916185 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-AttachVolumeTestJSON-1368644544 Sep 07 16:07:18.916185 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Id: a446dbd47db84c4987a3ee5332356b84 Sep 07 16:07:18.916185 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1368644544 Sep 07 16:07:18.916185 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User: tempest-AttachVolumeTestJSON-1368644544-project Sep 07 16:07:18.916185 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Sep 07 16:07:18.916185 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Sep 07 16:07:18.916185 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Id: 2fcfbaf5bab14a4783ca912a222341c0 Sep 07 16:07:18.916185 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-AttachVolumeTestJSON-1368644544-project Sep 07 16:07:18.916185 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: method: > Sep 07 16:07:18.916185 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: exception: Instance dc89b872-7af6-430f-ab73-119715d4cbac could not be found. Sep 07 16:07:18.916185 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: action_args: {'id': 'dc89b872-7af6-430f-ab73-119715d4cbac'} Sep 07 16:07:18.917411 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 16:07:18.917411 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:07:18.917411 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 16:07:18.917411 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 16:07:18.917411 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 16:07:18.917411 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 16:07:18.917411 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 16:07:18.917411 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 16:07:18.917411 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 16:07:18.917411 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 16:07:18.917411 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc89b872-7af6-430f-ab73-119715d4cbac could not be found. Sep 07 16:07:18.917411 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:07:18.917411 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:07:18.917411 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:07:18.917411 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:07:18.917411 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:07:18.917411 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:07:18.917411 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 16:07:18.917411 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 16:07:18.917411 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 16:07:18.918868 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 16:07:18.918868 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 16:07:18.918868 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 16:07:18.918868 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 16:07:18.918868 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 16:07:18.918868 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 16:07:18.918868 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 16:07:18.918868 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc89b872-7af6-430f-ab73-119715d4cbac could not be found. Sep 07 16:07:18.918868 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:07:18.918868 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:07:18.918868 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:07:18.918868 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:07:18.918868 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:07:18.918868 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:07:18.918868 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 16:07:18.918868 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 16:07:18.918868 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc89b872-7af6-430f-ab73-119715d4cbac could not be found. Sep 07 16:07:18.918868 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:07:18.922823 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-706ca20b-6e70-4264-a45c-1b962c278f24 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Returning 404 to user: Instance dc89b872-7af6-430f-ab73-119715d4cbac could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 16:07:18.922823 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-706ca20b-6e70-4264-a45c-1b962c278f24 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac" status: 404 len: 111 microversion: 2.1 time: 0.032901 Sep 07 16:07:18.922823 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 542/1067] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:07:18 2022] GET /compute/v2.1/servers/dc89b872-7af6-430f-ab73-119715d4cbac => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 16:07:20.069869 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c21e8c3c-9d86-46ca-bc34-9797193201ad tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:07:20.070372 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c21e8c3c-9d86-46ca-bc34-9797193201ad tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:07:20.072822 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:07:20.078147 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c21e8c3c-9d86-46ca-bc34-9797193201ad tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:07:20.078640 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c21e8c3c-9d86-46ca-bc34-9797193201ad tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:07:20.079084 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c21e8c3c-9d86-46ca-bc34-9797193201ad tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:07:20.081527 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c21e8c3c-9d86-46ca-bc34-9797193201ad tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:07:20.082000 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c21e8c3c-9d86-46ca-bc34-9797193201ad tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:07:20.082438 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c21e8c3c-9d86-46ca-bc34-9797193201ad tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:07:20.088835 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:07:20.099155 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-c21e8c3c-9d86-46ca-bc34-9797193201ad tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] HTTP exception thrown: Instance d9f7188c-7dad-469c-b915-511d7f6f7a14 could not be found. Sep 07 16:07:20.100830 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c21e8c3c-9d86-46ca-bc34-9797193201ad tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Request method failure captured: Sep 07 16:07:20.100830 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: request: DELETE /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 HTTP/1.1 Sep 07 16:07:20.100830 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Accept: application/json Sep 07 16:07:20.100830 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Accept-Encoding: identity Sep 07 16:07:20.100830 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Connection: close Sep 07 16:07:20.100830 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Content-Length: 0 Sep 07 16:07:20.100830 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Content-Type: application/json Sep 07 16:07:20.100830 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Host: 10.222.0.17 Sep 07 16:07:20.100830 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Openstack-System-Scope: None Sep 07 16:07:20.100830 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Sep 07 16:07:20.100830 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjGL-dAAjtQX0BBXg33LYFvaSUKZB2bRbxMUhHSHg00Fvmow_9lu17BLkz1nJJgHoEEvSo9hsLiYfdxAGFpdgpu_DK1O22QaIqj2pcyAjUKkETT2aPl97blUlEndVWe7u0yPav2HWLaLZ_Ls49JGwXa24vQHSKAQ5iMrT_eJl8dfvq_Ps Sep 07 16:07:20.100830 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Domain-Id: None Sep 07 16:07:20.100830 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Domain-Name: None Sep 07 16:07:20.100830 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Identity-Status: Confirmed Sep 07 16:07:20.100830 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Is-Admin-Project: True Sep 07 16:07:20.100830 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Domain-Id: default Sep 07 16:07:20.100830 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Domain-Name: Default Sep 07 16:07:20.100830 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Id: a446dbd47db84c4987a3ee5332356b84 Sep 07 16:07:20.100830 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Name: tempest-AttachVolumeTestJSON-1368644544 Sep 07 16:07:20.100830 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Role: reader,member Sep 07 16:07:20.100830 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Roles: reader,member Sep 07 16:07:20.102329 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a446dbd47db84c4987a3ee5332356b84", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a446dbd47db84c4987a3ee5332356b84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a446dbd47db84c4987a3ee5332356b84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a446dbd47db84c4987a3ee5332356b84"}]}] Sep 07 16:07:20.102329 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant: tempest-AttachVolumeTestJSON-1368644544 Sep 07 16:07:20.102329 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant-Id: a446dbd47db84c4987a3ee5332356b84 Sep 07 16:07:20.102329 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1368644544 Sep 07 16:07:20.102329 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User: tempest-AttachVolumeTestJSON-1368644544-project Sep 07 16:07:20.102329 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Domain-Id: default Sep 07 16:07:20.102329 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Domain-Name: Default Sep 07 16:07:20.102329 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Id: 2fcfbaf5bab14a4783ca912a222341c0 Sep 07 16:07:20.102329 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Name: tempest-AttachVolumeTestJSON-1368644544-project Sep 07 16:07:20.102329 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: method: > Sep 07 16:07:20.102329 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: exception: Instance d9f7188c-7dad-469c-b915-511d7f6f7a14 could not be found. Sep 07 16:07:20.102329 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: action_args: {'id': 'd9f7188c-7dad-469c-b915-511d7f6f7a14'} Sep 07 16:07:20.103094 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 16:07:20.103094 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:07:20.103094 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 16:07:20.103094 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 16:07:20.103094 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 16:07:20.103094 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 16:07:20.103094 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 16:07:20.103094 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 16:07:20.103094 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 16:07:20.103094 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 16:07:20.103094 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9f7188c-7dad-469c-b915-511d7f6f7a14 could not be found. Sep 07 16:07:20.103094 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:07:20.103094 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:07:20.103094 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:07:20.103094 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:07:20.103094 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:07:20.103094 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:07:20.103094 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 16:07:20.103094 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 16:07:20.103094 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 16:07:20.104386 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 16:07:20.104386 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 16:07:20.104386 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 16:07:20.104386 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 16:07:20.104386 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 16:07:20.104386 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 16:07:20.104386 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 16:07:20.104386 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 16:07:20.104386 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 16:07:20.104386 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9f7188c-7dad-469c-b915-511d7f6f7a14 could not be found. Sep 07 16:07:20.104386 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:07:20.104386 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:07:20.104386 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:07:20.104386 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:07:20.104386 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:07:20.104386 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:07:20.104386 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 16:07:20.104386 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 16:07:20.104386 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9f7188c-7dad-469c-b915-511d7f6f7a14 could not be found. Sep 07 16:07:20.104386 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:07:20.105648 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c21e8c3c-9d86-46ca-bc34-9797193201ad tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Returning 404 to user: Instance d9f7188c-7dad-469c-b915-511d7f6f7a14 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 16:07:20.105648 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c21e8c3c-9d86-46ca-bc34-9797193201ad tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 404 len: 111 microversion: 2.1 time: 0.036711 Sep 07 16:07:20.105648 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 526/1068] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Sep 7 16:07:20 2022] DELETE /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 16:07:20.110699 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a3ef6866-de8a-4c20-b0a3-8d9165128644 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:07:20.111319 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a3ef6866-de8a-4c20-b0a3-8d9165128644 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] [instance: d9f7188c-7dad-469c-b915-511d7f6f7a14] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:07:20.117752 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3ef6866-de8a-4c20-b0a3-8d9165128644 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:07:20.118405 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3ef6866-de8a-4c20-b0a3-8d9165128644 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:07:20.118851 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3ef6866-de8a-4c20-b0a3-8d9165128644 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:07:20.119604 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3ef6866-de8a-4c20-b0a3-8d9165128644 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:07:20.120067 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3ef6866-de8a-4c20-b0a3-8d9165128644 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:07:20.120499 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a3ef6866-de8a-4c20-b0a3-8d9165128644 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:07:20.134611 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-a3ef6866-de8a-4c20-b0a3-8d9165128644 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] HTTP exception thrown: Instance d9f7188c-7dad-469c-b915-511d7f6f7a14 could not be found. Sep 07 16:07:20.136188 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a3ef6866-de8a-4c20-b0a3-8d9165128644 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Request method failure captured: Sep 07 16:07:20.136188 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 HTTP/1.1 Sep 07 16:07:20.136188 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept: application/json Sep 07 16:07:20.136188 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Sep 07 16:07:20.136188 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Connection: close Sep 07 16:07:20.136188 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Length: 0 Sep 07 16:07:20.136188 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Type: application/json Sep 07 16:07:20.136188 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Host: 10.222.0.17 Sep 07 16:07:20.136188 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Sep 07 16:07:20.136188 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Sep 07 16:07:20.136188 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjGL-dAAjtQX0BBXg33LYFvaSUKZB2bRbxMUhHSHg00Fvmow_9lu17BLkz1nJJgHoEEvSo9hsLiYfdxAGFpdgpu_DK1O22QaIqj2pcyAjUKkETT2aPl97blUlEndVWe7u0yPav2HWLaLZ_Ls49JGwXa24vQHSKAQ5iMrT_eJl8dfvq_Ps Sep 07 16:07:20.136188 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Sep 07 16:07:20.136188 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Sep 07 16:07:20.136188 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Sep 07 16:07:20.136188 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Sep 07 16:07:20.136188 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Sep 07 16:07:20.136188 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Sep 07 16:07:20.136188 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Id: a446dbd47db84c4987a3ee5332356b84 Sep 07 16:07:20.136188 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-AttachVolumeTestJSON-1368644544 Sep 07 16:07:20.136188 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Role: reader,member Sep 07 16:07:20.136188 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Roles: reader,member Sep 07 16:07:20.137631 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a446dbd47db84c4987a3ee5332356b84", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a446dbd47db84c4987a3ee5332356b84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a446dbd47db84c4987a3ee5332356b84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a446dbd47db84c4987a3ee5332356b84"}]}] Sep 07 16:07:20.137631 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-AttachVolumeTestJSON-1368644544 Sep 07 16:07:20.137631 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Id: a446dbd47db84c4987a3ee5332356b84 Sep 07 16:07:20.137631 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1368644544 Sep 07 16:07:20.137631 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User: tempest-AttachVolumeTestJSON-1368644544-project Sep 07 16:07:20.137631 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Sep 07 16:07:20.137631 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Sep 07 16:07:20.137631 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Id: 2fcfbaf5bab14a4783ca912a222341c0 Sep 07 16:07:20.137631 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-AttachVolumeTestJSON-1368644544-project Sep 07 16:07:20.137631 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: method: > Sep 07 16:07:20.137631 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: exception: Instance d9f7188c-7dad-469c-b915-511d7f6f7a14 could not be found. Sep 07 16:07:20.137631 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: action_args: {'id': 'd9f7188c-7dad-469c-b915-511d7f6f7a14'} Sep 07 16:07:20.138481 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 16:07:20.138481 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:07:20.138481 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 16:07:20.138481 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 16:07:20.138481 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 16:07:20.138481 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 16:07:20.138481 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 16:07:20.138481 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 16:07:20.138481 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 16:07:20.138481 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 16:07:20.138481 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9f7188c-7dad-469c-b915-511d7f6f7a14 could not be found. Sep 07 16:07:20.138481 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:07:20.138481 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:07:20.138481 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:07:20.138481 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:07:20.138481 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:07:20.138481 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:07:20.138481 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 16:07:20.138481 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 16:07:20.138481 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 16:07:20.139738 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 16:07:20.139738 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 16:07:20.139738 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 16:07:20.139738 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 16:07:20.139738 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 16:07:20.139738 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 16:07:20.139738 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 16:07:20.139738 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9f7188c-7dad-469c-b915-511d7f6f7a14 could not be found. Sep 07 16:07:20.139738 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:07:20.139738 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:07:20.139738 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:07:20.139738 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:07:20.139738 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:07:20.139738 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:07:20.139738 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 16:07:20.139738 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 16:07:20.139738 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9f7188c-7dad-469c-b915-511d7f6f7a14 could not be found. Sep 07 16:07:20.139738 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:07:20.140887 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a3ef6866-de8a-4c20-b0a3-8d9165128644 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] Returning 404 to user: Instance d9f7188c-7dad-469c-b915-511d7f6f7a14 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 16:07:20.140887 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a3ef6866-de8a-4c20-b0a3-8d9165128644 tempest-AttachVolumeTestJSON-1368644544 tempest-AttachVolumeTestJSON-1368644544-project] 10.222.0.17 "GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14" status: 404 len: 111 microversion: 2.1 time: 0.030669 Sep 07 16:07:20.141529 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 543/1069] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:07:20 2022] GET /compute/v2.1/servers/d9f7188c-7dad-469c-b915-511d7f6f7a14 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 16:07:49.786854 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:07:49.973938 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4309ff20-65e2-422e-bbc9-892631be0a02 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Action: 'create', calling method: .version_select at 0x7ff9a69519d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-170325714", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGB6UZhBsiuA8Zv9KVIkDrDdumIXRYIoM+mMX6sfzs9ai5hTXQ+Q06hQowOCTxtof2mUUuXffHuyOdg6f+5b6zbNjzRivDNUodBo0I/UL3v4jP/7FW6TP1hradAMkrMp+g=="}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:07:49.989831 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.quota [None req-4309ff20-65e2-422e-bbc9-892631be0a02 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Getting quotas for project 266789e160554ec0a0a334304a0ad39d. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 16:07:49.994704 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.quota [None req-4309ff20-65e2-422e-bbc9-892631be0a02 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Getting quotas for user 22aa615f2c7c4c6eaa694f551e38436a and project 266789e160554ec0a0a334304a0ad39d. Resources: {'key_pairs'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 16:07:50.018628 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4309ff20-65e2-422e-bbc9-892631be0a02 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.237268 Sep 07 16:07:50.025466 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 527/1070] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Sep 7 16:07:49 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:08:18.180208 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f3cdcd7e-70b3-467e-b816-50027c652894 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:18.180737 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f3cdcd7e-70b3-467e-b816-50027c652894 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: d43ccf07-e0c3-46a2-b4f2-00db2672aced] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:18.182765 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:08:18.183396 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=4 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:08:18.184401 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 16:08:18.184537 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Wed Sep 7 16:08:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d43ccf07-e0c3-46a2-b4f2-00db2672aced/ips (ip 10.222.0.17) !!! Sep 07 16:08:18.196677 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3cdcd7e-70b3-467e-b816-50027c652894 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:18.197178 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3cdcd7e-70b3-467e-b816-50027c652894 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:18.197614 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3cdcd7e-70b3-467e-b816-50027c652894 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:18.198302 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3cdcd7e-70b3-467e-b816-50027c652894 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:18.198755 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3cdcd7e-70b3-467e-b816-50027c652894 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:18.199177 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3cdcd7e-70b3-467e-b816-50027c652894 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:18.221662 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f3cdcd7e-70b3-467e-b816-50027c652894 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/d43ccf07-e0c3-46a2-b4f2-00db2672aced/ips" status: 200 len: 150 microversion: 2.1 time: 0.046264 Sep 07 16:08:18.222978 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 544/1071] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Sep 7 16:08:18 2022] GET /compute/v2.1/servers/d43ccf07-e0c3-46a2-b4f2-00db2672aced/ips => generated 150 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:08:18.232117 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:08:18.232869 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=4 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:08:18.233705 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:08:18.238700 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-457a394f-3f6e-472d-8d69-ca8ac636d73b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f68b24e6-85ec-49db-96d4-d47157fda265"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:08:18.243254 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-457a394f-3f6e-472d-8d69-ca8ac636d73b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: d43ccf07-e0c3-46a2-b4f2-00db2672aced] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:18.250960 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-457a394f-3f6e-472d-8d69-ca8ac636d73b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:18.251449 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-457a394f-3f6e-472d-8d69-ca8ac636d73b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:18.251911 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-457a394f-3f6e-472d-8d69-ca8ac636d73b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:18.252606 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-457a394f-3f6e-472d-8d69-ca8ac636d73b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:18.253061 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-457a394f-3f6e-472d-8d69-ca8ac636d73b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:18.253538 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-457a394f-3f6e-472d-8d69-ca8ac636d73b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:18.330013 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-457a394f-3f6e-472d-8d69-ca8ac636d73b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] HTTP exception thrown: Invalid volume: volume f68b24e6-85ec-49db-96d4-d47157fda265 is already attached to instances: 8ae4d7f1-1422-4346-84ab-72682ad0a928 Sep 07 16:08:18.331681 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-457a394f-3f6e-472d-8d69-ca8ac636d73b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Request method failure captured: Sep 07 16:08:18.331681 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: request: POST /compute/v2.1/servers/d43ccf07-e0c3-46a2-b4f2-00db2672aced/os-volume_attachments HTTP/1.1 Sep 07 16:08:18.331681 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Accept: application/json Sep 07 16:08:18.331681 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Accept-Encoding: identity Sep 07 16:08:18.331681 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Connection: close Sep 07 16:08:18.331681 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Content-Length: 74 Sep 07 16:08:18.331681 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Content-Type: application/json Sep 07 16:08:18.331681 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Host: 10.222.0.17 Sep 07 16:08:18.331681 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Openstack-System-Scope: None Sep 07 16:08:18.331681 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Sep 07 16:08:18.331681 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjGMEEfdw4OUg2B39RKswOmT5z54ISjPs9Ys-pBh0gUFq_XPVQCzkiphko1MTfezgc9xGOiE9M4-fp-aoq8efmnODenpErT0vQYyVQWrBzaRRoo-wl5i6l7H-bvKljvP6w5U1cAwX2okeVPnYRC9X59Bw9YuV07_v6iRyvOmKt9QO33DU Sep 07 16:08:18.331681 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Domain-Id: None Sep 07 16:08:18.331681 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Domain-Name: None Sep 07 16:08:18.331681 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Identity-Status: Confirmed Sep 07 16:08:18.331681 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Is-Admin-Project: True Sep 07 16:08:18.331681 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Domain-Id: default Sep 07 16:08:18.331681 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Domain-Name: Default Sep 07 16:08:18.331681 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Id: ab1963a1a6684af58f5c240787788b60 Sep 07 16:08:18.331681 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Name: tempest-AttachVolumeNegativeTest-857872657 Sep 07 16:08:18.331681 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Role: reader,member Sep 07 16:08:18.331681 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Roles: reader,member Sep 07 16:08:18.333363 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ab1963a1a6684af58f5c240787788b60", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ab1963a1a6684af58f5c240787788b60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ab1963a1a6684af58f5c240787788b60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ab1963a1a6684af58f5c240787788b60"}]}] Sep 07 16:08:18.333363 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant: tempest-AttachVolumeNegativeTest-857872657 Sep 07 16:08:18.333363 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant-Id: ab1963a1a6684af58f5c240787788b60 Sep 07 16:08:18.333363 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-857872657 Sep 07 16:08:18.333363 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User: tempest-AttachVolumeNegativeTest-857872657-project Sep 07 16:08:18.333363 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Domain-Id: default Sep 07 16:08:18.333363 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Domain-Name: Default Sep 07 16:08:18.333363 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Id: 2dab44e593194fe788216b029eecd10c Sep 07 16:08:18.333363 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Name: tempest-AttachVolumeNegativeTest-857872657-project Sep 07 16:08:18.333363 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Sep 07 16:08:18.333363 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: {"volumeAttachment": {"volumeId": "f68b24e6-85ec-49db-96d4-d47157fda265"}} Sep 07 16:08:18.333363 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: method: > Sep 07 16:08:18.334327 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: exception: Invalid volume: volume f68b24e6-85ec-49db-96d4-d47157fda265 is already attached to instances: 8ae4d7f1-1422-4346-84ab-72682ad0a928 Sep 07 16:08:18.334327 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: action_args: {'server_id': 'd43ccf07-e0c3-46a2-b4f2-00db2672aced', 'body': {'volumeAttachment': {'volumeId': 'f68b24e6-85ec-49db-96d4-d47157fda265'}}} Sep 07 16:08:18.334327 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 16:08:18.334327 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:08:18.334327 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 07 16:08:18.334327 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 07 16:08:18.334327 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 16:08:18.334327 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 16:08:18.334327 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 07 16:08:18.334327 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 07 16:08:18.334327 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 07 16:08:18.334327 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 07 16:08:18.334327 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 07 16:08:18.334327 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 07 16:08:18.334327 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f68b24e6-85ec-49db-96d4-d47157fda265 is already attached to instances: 8ae4d7f1-1422-4346-84ab-72682ad0a928 Sep 07 16:08:18.334327 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:08:18.334327 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:08:18.334327 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:08:18.334327 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:08:18.335797 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:08:18.335797 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:08:18.335797 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 16:08:18.335797 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 16:08:18.335797 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 16:08:18.335797 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 16:08:18.335797 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 16:08:18.335797 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 16:08:18.335797 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 16:08:18.335797 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 16:08:18.335797 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 16:08:18.335797 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 16:08:18.335797 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 07 16:08:18.335797 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 07 16:08:18.335797 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f68b24e6-85ec-49db-96d4-d47157fda265 is already attached to instances: 8ae4d7f1-1422-4346-84ab-72682ad0a928 Sep 07 16:08:18.335797 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:08:18.335797 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:08:18.335797 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:08:18.335797 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:08:18.335797 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:08:18.337116 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:08:18.337116 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 16:08:18.337116 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 16:08:18.337116 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f68b24e6-85ec-49db-96d4-d47157fda265 is already attached to instances: 8ae4d7f1-1422-4346-84ab-72682ad0a928 Sep 07 16:08:18.337116 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:08:18.337116 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-457a394f-3f6e-472d-8d69-ca8ac636d73b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Returning 400 to user: Invalid volume: volume f68b24e6-85ec-49db-96d4-d47157fda265 is already attached to instances: 8ae4d7f1-1422-4346-84ab-72682ad0a928 {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 16:08:18.337116 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-457a394f-3f6e-472d-8d69-ca8ac636d73b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "POST /compute/v2.1/servers/d43ccf07-e0c3-46a2-b4f2-00db2672aced/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102633 Sep 07 16:08:18.337116 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 528/1072] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Sep 7 16:08:18 2022] POST /compute/v2.1/servers/d43ccf07-e0c3-46a2-b4f2-00db2672aced/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 16:08:18.341812 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8c1f1d16-04bc-4fef-859f-93eef4d8cad0 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:18.342306 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8c1f1d16-04bc-4fef-859f-93eef4d8cad0 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: d43ccf07-e0c3-46a2-b4f2-00db2672aced] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:18.348962 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c1f1d16-04bc-4fef-859f-93eef4d8cad0 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:18.349440 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c1f1d16-04bc-4fef-859f-93eef4d8cad0 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:18.349872 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c1f1d16-04bc-4fef-859f-93eef4d8cad0 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:18.350551 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c1f1d16-04bc-4fef-859f-93eef4d8cad0 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:18.350999 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c1f1d16-04bc-4fef-859f-93eef4d8cad0 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:18.351428 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8c1f1d16-04bc-4fef-859f-93eef4d8cad0 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:18.375844 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8c1f1d16-04bc-4fef-859f-93eef4d8cad0 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: d43ccf07-e0c3-46a2-b4f2-00db2672aced] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 16:08:18.449978 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8c1f1d16-04bc-4fef-859f-93eef4d8cad0 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d43ccf07-e0c3-46a2-b4f2-00db2672aced" status: 204 len: 0 microversion: 2.1 time: 0.111760 Sep 07 16:08:18.450569 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 545/1073] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Sep 7 16:08:18 2022] DELETE /compute/v2.1/servers/d43ccf07-e0c3-46a2-b4f2-00db2672aced => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 16:08:18.459858 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-abc127fe-98d6-4ee9-bb98-4b28894484dd tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:18.460470 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-abc127fe-98d6-4ee9-bb98-4b28894484dd tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: d43ccf07-e0c3-46a2-b4f2-00db2672aced] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:18.466437 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-abc127fe-98d6-4ee9-bb98-4b28894484dd tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:18.466919 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-abc127fe-98d6-4ee9-bb98-4b28894484dd tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:18.467345 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-abc127fe-98d6-4ee9-bb98-4b28894484dd tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:18.468077 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-abc127fe-98d6-4ee9-bb98-4b28894484dd tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:18.468529 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-abc127fe-98d6-4ee9-bb98-4b28894484dd tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:18.468953 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-abc127fe-98d6-4ee9-bb98-4b28894484dd tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:18.602568 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-abc127fe-98d6-4ee9-bb98-4b28894484dd tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:18.610306 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-abc127fe-98d6-4ee9-bb98-4b28894484dd tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/d43ccf07-e0c3-46a2-b4f2-00db2672aced" status: 200 len: 1681 microversion: 2.1 time: 0.154320 Sep 07 16:08:18.610877 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 529/1074] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:18 2022] GET /compute/v2.1/servers/d43ccf07-e0c3-46a2-b4f2-00db2672aced => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:08:19.634005 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-14176271-6e25-4daa-a448-5f62f06de8f7 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:19.634706 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-14176271-6e25-4daa-a448-5f62f06de8f7 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: d43ccf07-e0c3-46a2-b4f2-00db2672aced] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:19.641176 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-14176271-6e25-4daa-a448-5f62f06de8f7 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:19.641683 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-14176271-6e25-4daa-a448-5f62f06de8f7 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:19.642118 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-14176271-6e25-4daa-a448-5f62f06de8f7 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:19.642799 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-14176271-6e25-4daa-a448-5f62f06de8f7 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:19.643250 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-14176271-6e25-4daa-a448-5f62f06de8f7 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:19.643696 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-14176271-6e25-4daa-a448-5f62f06de8f7 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:19.775875 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-14176271-6e25-4daa-a448-5f62f06de8f7 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:19.783479 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-14176271-6e25-4daa-a448-5f62f06de8f7 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/d43ccf07-e0c3-46a2-b4f2-00db2672aced" status: 200 len: 1681 microversion: 2.1 time: 0.153669 Sep 07 16:08:19.784001 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 546/1075] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:19 2022] GET /compute/v2.1/servers/d43ccf07-e0c3-46a2-b4f2-00db2672aced => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:08:20.806805 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1e17b35b-8cdd-49c8-8e48-f6478d570900 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:20.807409 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1e17b35b-8cdd-49c8-8e48-f6478d570900 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: d43ccf07-e0c3-46a2-b4f2-00db2672aced] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:20.813818 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1e17b35b-8cdd-49c8-8e48-f6478d570900 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:20.814293 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1e17b35b-8cdd-49c8-8e48-f6478d570900 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:20.814722 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1e17b35b-8cdd-49c8-8e48-f6478d570900 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:20.815397 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1e17b35b-8cdd-49c8-8e48-f6478d570900 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:20.815872 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1e17b35b-8cdd-49c8-8e48-f6478d570900 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:20.816288 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1e17b35b-8cdd-49c8-8e48-f6478d570900 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:20.940996 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-1e17b35b-8cdd-49c8-8e48-f6478d570900 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:20.948982 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1e17b35b-8cdd-49c8-8e48-f6478d570900 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/d43ccf07-e0c3-46a2-b4f2-00db2672aced" status: 200 len: 1681 microversion: 2.1 time: 0.145938 Sep 07 16:08:20.949463 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 530/1076] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:20 2022] GET /compute/v2.1/servers/d43ccf07-e0c3-46a2-b4f2-00db2672aced => generated 1681 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:08:21.973994 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2edbeef7-837a-4b06-bfdd-7e5483d786f9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:21.974606 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2edbeef7-837a-4b06-bfdd-7e5483d786f9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: d43ccf07-e0c3-46a2-b4f2-00db2672aced] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:21.980953 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2edbeef7-837a-4b06-bfdd-7e5483d786f9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:21.981430 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2edbeef7-837a-4b06-bfdd-7e5483d786f9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:21.982253 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2edbeef7-837a-4b06-bfdd-7e5483d786f9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:21.982533 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2edbeef7-837a-4b06-bfdd-7e5483d786f9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:21.982982 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2edbeef7-837a-4b06-bfdd-7e5483d786f9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:21.983404 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2edbeef7-837a-4b06-bfdd-7e5483d786f9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:22.110267 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2edbeef7-837a-4b06-bfdd-7e5483d786f9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:22.118507 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2edbeef7-837a-4b06-bfdd-7e5483d786f9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/d43ccf07-e0c3-46a2-b4f2-00db2672aced" status: 200 len: 1681 microversion: 2.1 time: 0.149121 Sep 07 16:08:22.119054 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 547/1077] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:21 2022] GET /compute/v2.1/servers/d43ccf07-e0c3-46a2-b4f2-00db2672aced => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:08:23.144913 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-999880ca-e095-4fcd-bd88-06eadc2e9b38 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:23.146304 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-999880ca-e095-4fcd-bd88-06eadc2e9b38 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: d43ccf07-e0c3-46a2-b4f2-00db2672aced] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:23.167855 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-58659ac9-4ce5-44e1-8737-7d6803cbf254 req-047632d9-65ff-4901-9d6c-13f7594f87a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d43ccf07-e0c3-46a2-b4f2-00db2672aced", "name": "network-vif-deleted", "tag": "e730ca93-f556-47b1-a83d-b233763cbdfb"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:08:23.169153 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-999880ca-e095-4fcd-bd88-06eadc2e9b38 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:23.169990 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-999880ca-e095-4fcd-bd88-06eadc2e9b38 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:23.171348 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-999880ca-e095-4fcd-bd88-06eadc2e9b38 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:23.172376 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-999880ca-e095-4fcd-bd88-06eadc2e9b38 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:23.173051 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-999880ca-e095-4fcd-bd88-06eadc2e9b38 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:23.173706 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-999880ca-e095-4fcd-bd88-06eadc2e9b38 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:23.188935 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-58659ac9-4ce5-44e1-8737-7d6803cbf254 req-047632d9-65ff-4901-9d6c-13f7594f87a9 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:23.189813 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-58659ac9-4ce5-44e1-8737-7d6803cbf254 req-047632d9-65ff-4901-9d6c-13f7594f87a9 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:23.194009 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-58659ac9-4ce5-44e1-8737-7d6803cbf254 req-047632d9-65ff-4901-9d6c-13f7594f87a9 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:23.206972 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-58659ac9-4ce5-44e1-8737-7d6803cbf254 req-047632d9-65ff-4901-9d6c-13f7594f87a9 service nova] Creating event network-vif-deleted:e730ca93-f556-47b1-a83d-b233763cbdfb for instance d43ccf07-e0c3-46a2-b4f2-00db2672aced on hv-cinder-85331 Sep 07 16:08:23.215115 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-58659ac9-4ce5-44e1-8737-7d6803cbf254 req-047632d9-65ff-4901-9d6c-13f7594f87a9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.239535 Sep 07 16:08:23.219985 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 531/1078] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:08:23.232708 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-999880ca-e095-4fcd-bd88-06eadc2e9b38 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:23.233189 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-999880ca-e095-4fcd-bd88-06eadc2e9b38 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:23.233635 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-999880ca-e095-4fcd-bd88-06eadc2e9b38 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:23.234448 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-999880ca-e095-4fcd-bd88-06eadc2e9b38 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lazy-loading 'fault' on Instance uuid d43ccf07-e0c3-46a2-b4f2-00db2672aced {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 16:08:23.280563 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-999880ca-e095-4fcd-bd88-06eadc2e9b38 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:23.289415 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-999880ca-e095-4fcd-bd88-06eadc2e9b38 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/d43ccf07-e0c3-46a2-b4f2-00db2672aced" status: 200 len: 1331 microversion: 2.1 time: 0.151393 Sep 07 16:08:23.290591 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 548/1079] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:23 2022] GET /compute/v2.1/servers/d43ccf07-e0c3-46a2-b4f2-00db2672aced => generated 1331 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 16:08:24.315210 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d1a40bcc-6722-4435-be04-acf4254744d3 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:24.315969 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d1a40bcc-6722-4435-be04-acf4254744d3 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: d43ccf07-e0c3-46a2-b4f2-00db2672aced] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:24.322289 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1a40bcc-6722-4435-be04-acf4254744d3 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:24.322779 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1a40bcc-6722-4435-be04-acf4254744d3 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:24.323220 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1a40bcc-6722-4435-be04-acf4254744d3 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:24.323950 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1a40bcc-6722-4435-be04-acf4254744d3 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:24.324415 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1a40bcc-6722-4435-be04-acf4254744d3 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:24.324866 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1a40bcc-6722-4435-be04-acf4254744d3 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:24.339974 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-d1a40bcc-6722-4435-be04-acf4254744d3 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] HTTP exception thrown: Instance d43ccf07-e0c3-46a2-b4f2-00db2672aced could not be found. Sep 07 16:08:24.341578 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d1a40bcc-6722-4435-be04-acf4254744d3 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Request method failure captured: Sep 07 16:08:24.341578 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/d43ccf07-e0c3-46a2-b4f2-00db2672aced HTTP/1.1 Sep 07 16:08:24.341578 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Accept: application/json Sep 07 16:08:24.341578 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Accept-Encoding: identity Sep 07 16:08:24.341578 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Connection: close Sep 07 16:08:24.341578 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Content-Length: 0 Sep 07 16:08:24.341578 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Content-Type: application/json Sep 07 16:08:24.341578 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Host: 10.222.0.17 Sep 07 16:08:24.341578 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Openstack-System-Scope: None Sep 07 16:08:24.341578 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Sep 07 16:08:24.341578 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjGMEEfdw4OUg2B39RKswOmT5z54ISjPs9Ys-pBh0gUFq_XPVQCzkiphko1MTfezgc9xGOiE9M4-fp-aoq8efmnODenpErT0vQYyVQWrBzaRRoo-wl5i6l7H-bvKljvP6w5U1cAwX2okeVPnYRC9X59Bw9YuV07_v6iRyvOmKt9QO33DU Sep 07 16:08:24.341578 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Domain-Id: None Sep 07 16:08:24.341578 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Domain-Name: None Sep 07 16:08:24.341578 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Identity-Status: Confirmed Sep 07 16:08:24.341578 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Is-Admin-Project: True Sep 07 16:08:24.341578 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Domain-Id: default Sep 07 16:08:24.341578 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Domain-Name: Default Sep 07 16:08:24.341578 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Id: ab1963a1a6684af58f5c240787788b60 Sep 07 16:08:24.341578 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Name: tempest-AttachVolumeNegativeTest-857872657 Sep 07 16:08:24.341578 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Role: reader,member Sep 07 16:08:24.341578 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Roles: reader,member Sep 07 16:08:24.343178 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ab1963a1a6684af58f5c240787788b60", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ab1963a1a6684af58f5c240787788b60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ab1963a1a6684af58f5c240787788b60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ab1963a1a6684af58f5c240787788b60"}]}] Sep 07 16:08:24.343178 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant: tempest-AttachVolumeNegativeTest-857872657 Sep 07 16:08:24.343178 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant-Id: ab1963a1a6684af58f5c240787788b60 Sep 07 16:08:24.343178 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-857872657 Sep 07 16:08:24.343178 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User: tempest-AttachVolumeNegativeTest-857872657-project Sep 07 16:08:24.343178 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Domain-Id: default Sep 07 16:08:24.343178 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Domain-Name: Default Sep 07 16:08:24.343178 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Id: 2dab44e593194fe788216b029eecd10c Sep 07 16:08:24.343178 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Name: tempest-AttachVolumeNegativeTest-857872657-project Sep 07 16:08:24.343178 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: method: > Sep 07 16:08:24.343178 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: exception: Instance d43ccf07-e0c3-46a2-b4f2-00db2672aced could not be found. Sep 07 16:08:24.343178 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: action_args: {'id': 'd43ccf07-e0c3-46a2-b4f2-00db2672aced'} Sep 07 16:08:24.344222 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 16:08:24.344222 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:08:24.344222 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 16:08:24.344222 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 16:08:24.344222 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 16:08:24.344222 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 16:08:24.344222 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 16:08:24.344222 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 16:08:24.344222 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 16:08:24.344222 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 16:08:24.344222 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d43ccf07-e0c3-46a2-b4f2-00db2672aced could not be found. Sep 07 16:08:24.344222 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:08:24.344222 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:08:24.344222 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:08:24.344222 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:08:24.344222 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:08:24.344222 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:08:24.344222 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 16:08:24.344222 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 16:08:24.344222 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 16:08:24.345904 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 16:08:24.345904 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 16:08:24.345904 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 16:08:24.345904 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 16:08:24.345904 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 16:08:24.345904 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 16:08:24.345904 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 16:08:24.345904 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d43ccf07-e0c3-46a2-b4f2-00db2672aced could not be found. Sep 07 16:08:24.345904 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:08:24.345904 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:08:24.345904 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:08:24.345904 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:08:24.345904 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:08:24.345904 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:08:24.345904 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 16:08:24.345904 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 16:08:24.345904 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d43ccf07-e0c3-46a2-b4f2-00db2672aced could not be found. Sep 07 16:08:24.345904 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:08:24.347793 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d1a40bcc-6722-4435-be04-acf4254744d3 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Returning 404 to user: Instance d43ccf07-e0c3-46a2-b4f2-00db2672aced could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 16:08:24.347793 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d1a40bcc-6722-4435-be04-acf4254744d3 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/d43ccf07-e0c3-46a2-b4f2-00db2672aced" status: 404 len: 111 microversion: 2.1 time: 0.032498 Sep 07 16:08:24.347793 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 532/1080] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:24 2022] GET /compute/v2.1/servers/d43ccf07-e0c3-46a2-b4f2-00db2672aced => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 16:08:24.353414 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-546e41ac-51a7-4cd4-bfb8-981973882182 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '.version_select at 0x7ff9a5c5a1f0>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:24.372978 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-546e41ac-51a7-4cd4-bfb8-981973882182 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1840516321" status: 202 len: 0 microversion: 2.1 time: 0.023264 Sep 07 16:08:24.373536 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 549/1081] 10.222.0.17 () {58 vars in 1221 bytes} [Wed Sep 7 16:08:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1840516321 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 16:08:25.025906 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fc274e60-335f-4982-8e6a-e377382cc5ee tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:25.026404 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fc274e60-335f-4982-8e6a-e377382cc5ee tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 8ae4d7f1-1422-4346-84ab-72682ad0a928] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:25.032377 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fc274e60-335f-4982-8e6a-e377382cc5ee tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:25.032869 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fc274e60-335f-4982-8e6a-e377382cc5ee tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:25.033300 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fc274e60-335f-4982-8e6a-e377382cc5ee tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:25.033988 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fc274e60-335f-4982-8e6a-e377382cc5ee tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:25.034441 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fc274e60-335f-4982-8e6a-e377382cc5ee tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:25.034864 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fc274e60-335f-4982-8e6a-e377382cc5ee tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:25.115237 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-fc274e60-335f-4982-8e6a-e377382cc5ee tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lazy-loading 'services' on Instance uuid 8ae4d7f1-1422-4346-84ab-72682ad0a928 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 16:08:25.186059 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fc274e60-335f-4982-8e6a-e377382cc5ee tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928/os-volume_attachments/f68b24e6-85ec-49db-96d4-d47157fda265" status: 202 len: 0 microversion: 2.1 time: 0.164686 Sep 07 16:08:25.187061 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 533/1082] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Sep 7 16:08:25 2022] DELETE /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928/os-volume_attachments/f68b24e6-85ec-49db-96d4-d47157fda265 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 16:08:25.195785 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3a9b4e93-36a0-4228-baea-cc686b1a7ec9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:25.198768 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3a9b4e93-36a0-4228-baea-cc686b1a7ec9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 8ae4d7f1-1422-4346-84ab-72682ad0a928] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:25.206820 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a9b4e93-36a0-4228-baea-cc686b1a7ec9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:25.207357 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a9b4e93-36a0-4228-baea-cc686b1a7ec9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:25.208124 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a9b4e93-36a0-4228-baea-cc686b1a7ec9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:25.209582 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a9b4e93-36a0-4228-baea-cc686b1a7ec9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:25.210286 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a9b4e93-36a0-4228-baea-cc686b1a7ec9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:25.210926 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3a9b4e93-36a0-4228-baea-cc686b1a7ec9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:25.250844 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3a9b4e93-36a0-4228-baea-cc686b1a7ec9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059330 Sep 07 16:08:25.251459 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 550/1083] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Sep 7 16:08:25 2022] GET /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:08:26.264226 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d7317e65-af46-4cb5-8409-234c0e2b226e tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:26.266451 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d7317e65-af46-4cb5-8409-234c0e2b226e tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 8ae4d7f1-1422-4346-84ab-72682ad0a928] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:26.273846 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d7317e65-af46-4cb5-8409-234c0e2b226e tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:26.274333 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d7317e65-af46-4cb5-8409-234c0e2b226e tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:26.274768 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d7317e65-af46-4cb5-8409-234c0e2b226e tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:26.275458 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d7317e65-af46-4cb5-8409-234c0e2b226e tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:26.275943 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d7317e65-af46-4cb5-8409-234c0e2b226e tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:26.276367 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d7317e65-af46-4cb5-8409-234c0e2b226e tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:26.306326 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d7317e65-af46-4cb5-8409-234c0e2b226e tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046470 Sep 07 16:08:26.306881 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 534/1084] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Sep 7 16:08:26 2022] GET /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:08:26.342074 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-72084cbf-5b04-475b-8662-690edde9607e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-326605924", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-170325714", "security_groups": [{"name": "tempest-secgroup-smoke-1680367303"}], "networks": [{"uuid": "4f182b09-ce64-459d-a0ea-73280b2344de"}], "block_device_mapping_v2": [{"uuid": "0ced4307-9541-49b7-8baf-7fa0c89235ca", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:08:26.452798 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-72084cbf-5b04-475b-8662-690edde9607e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] validate_networks() for [('4f182b09-ce64-459d-a0ea-73280b2344de', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 16:08:26.918633 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-72084cbf-5b04-475b-8662-690edde9607e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 16:08:26.919196 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-72084cbf-5b04-475b-8662-690edde9607e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 16:08:26.919699 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-72084cbf-5b04-475b-8662-690edde9607e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 16:08:26.920100 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-72084cbf-5b04-475b-8662-690edde9607e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 16:08:26.920502 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-72084cbf-5b04-475b-8662-690edde9607e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 16:08:26.929610 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-72084cbf-5b04-475b-8662-690edde9607e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:26.930082 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-72084cbf-5b04-475b-8662-690edde9607e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:26.930503 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-72084cbf-5b04-475b-8662-690edde9607e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:26.931214 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-72084cbf-5b04-475b-8662-690edde9607e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:26.931691 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-72084cbf-5b04-475b-8662-690edde9607e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:26.932110 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-72084cbf-5b04-475b-8662-690edde9607e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:26.948720 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-72084cbf-5b04-475b-8662-690edde9607e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Getting quotas for project 266789e160554ec0a0a334304a0ad39d. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 16:08:26.952600 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-72084cbf-5b04-475b-8662-690edde9607e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Getting quotas for user 22aa615f2c7c4c6eaa694f551e38436a and project 266789e160554ec0a0a334304a0ad39d. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 16:08:27.008498 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-72084cbf-5b04-475b-8662-690edde9607e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 16:08:27.010569 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-72084cbf-5b04-475b-8662-690edde9607e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0ced4307-9541-49b7-8baf-7fa0c89235ca',volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 16:08:27.135863 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-72084cbf-5b04-475b-8662-690edde9607e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.797503 Sep 07 16:08:27.136495 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 551/1085] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Sep 7 16:08:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 07 16:08:27.147640 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ccb2ea45-2b4c-4cb5-bce6-b6f45b75ea83 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:27.148360 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ccb2ea45-2b4c-4cb5-bce6-b6f45b75ea83 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:27.204146 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-ccb2ea45-2b4c-4cb5-bce6-b6f45b75ea83 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aa615f2c7c4c6eaa694f551e38436a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266789e160554ec0a0a334304a0ad39d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:27.210946 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ccb2ea45-2b4c-4cb5-bce6-b6f45b75ea83 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 200 len: 1087 microversion: 2.1 time: 0.067274 Sep 07 16:08:27.211516 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 535/1086] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:27 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 1087 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:08:27.319376 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ad141597-f307-40db-8781-e8c6cfe62f0b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:27.322708 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ad141597-f307-40db-8781-e8c6cfe62f0b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 8ae4d7f1-1422-4346-84ab-72682ad0a928] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:27.332076 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad141597-f307-40db-8781-e8c6cfe62f0b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:27.332788 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad141597-f307-40db-8781-e8c6cfe62f0b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:27.333292 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad141597-f307-40db-8781-e8c6cfe62f0b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:27.334839 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad141597-f307-40db-8781-e8c6cfe62f0b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:27.335338 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad141597-f307-40db-8781-e8c6cfe62f0b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:27.336025 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ad141597-f307-40db-8781-e8c6cfe62f0b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:27.369707 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ad141597-f307-40db-8781-e8c6cfe62f0b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055243 Sep 07 16:08:27.370439 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 552/1087] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Sep 7 16:08:27 2022] GET /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:08:28.233734 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e6d08a98-2c88-4529-896e-6bc56e52d45a tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:28.234251 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e6d08a98-2c88-4529-896e-6bc56e52d45a tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:28.241994 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e6d08a98-2c88-4529-896e-6bc56e52d45a tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:28.242485 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e6d08a98-2c88-4529-896e-6bc56e52d45a tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:28.242916 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e6d08a98-2c88-4529-896e-6bc56e52d45a tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:28.243630 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e6d08a98-2c88-4529-896e-6bc56e52d45a tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:28.244087 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e6d08a98-2c88-4529-896e-6bc56e52d45a tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:28.244509 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e6d08a98-2c88-4529-896e-6bc56e52d45a tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:28.307982 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-e6d08a98-2c88-4529-896e-6bc56e52d45a tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aa615f2c7c4c6eaa694f551e38436a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266789e160554ec0a0a334304a0ad39d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:28.316001 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e6d08a98-2c88-4529-896e-6bc56e52d45a tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 200 len: 1185 microversion: 2.1 time: 0.086134 Sep 07 16:08:28.316629 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 536/1088] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:28 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 1185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:08:28.382660 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-38a343b2-15fe-4254-93c6-3dec136e151f tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:28.385102 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-38a343b2-15fe-4254-93c6-3dec136e151f tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 8ae4d7f1-1422-4346-84ab-72682ad0a928] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:28.398006 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38a343b2-15fe-4254-93c6-3dec136e151f tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:28.399016 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38a343b2-15fe-4254-93c6-3dec136e151f tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:28.399860 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38a343b2-15fe-4254-93c6-3dec136e151f tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:28.400810 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38a343b2-15fe-4254-93c6-3dec136e151f tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:28.401471 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38a343b2-15fe-4254-93c6-3dec136e151f tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:28.402097 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-38a343b2-15fe-4254-93c6-3dec136e151f tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:28.439915 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-38a343b2-15fe-4254-93c6-3dec136e151f tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061833 Sep 07 16:08:28.440780 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 553/1089] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Sep 7 16:08:28 2022] GET /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 07 16:08:28.506565 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-cf73610d-422a-4442-be5a-46eb041e8caa tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:28.507055 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cf73610d-422a-4442-be5a-46eb041e8caa tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 8ae4d7f1-1422-4346-84ab-72682ad0a928] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:28.513315 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf73610d-422a-4442-be5a-46eb041e8caa tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:28.513812 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf73610d-422a-4442-be5a-46eb041e8caa tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:28.514250 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf73610d-422a-4442-be5a-46eb041e8caa tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:28.514953 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf73610d-422a-4442-be5a-46eb041e8caa tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:28.515414 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf73610d-422a-4442-be5a-46eb041e8caa tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:28.515867 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-cf73610d-422a-4442-be5a-46eb041e8caa tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:28.542836 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-cf73610d-422a-4442-be5a-46eb041e8caa tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 8ae4d7f1-1422-4346-84ab-72682ad0a928] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 16:08:28.622937 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-cf73610d-422a-4442-be5a-46eb041e8caa tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928" status: 204 len: 0 microversion: 2.1 time: 0.120714 Sep 07 16:08:28.623896 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 537/1090] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Sep 7 16:08:28 2022] DELETE /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 16:08:28.632053 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-85569406-7616-40e4-b5da-7e3897be377e tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:28.632887 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-85569406-7616-40e4-b5da-7e3897be377e tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 8ae4d7f1-1422-4346-84ab-72682ad0a928] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:28.638696 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85569406-7616-40e4-b5da-7e3897be377e tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:28.639169 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85569406-7616-40e4-b5da-7e3897be377e tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:28.639634 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85569406-7616-40e4-b5da-7e3897be377e tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:28.640319 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85569406-7616-40e4-b5da-7e3897be377e tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:28.640761 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85569406-7616-40e4-b5da-7e3897be377e tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:28.641179 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-85569406-7616-40e4-b5da-7e3897be377e tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:28.777564 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-85569406-7616-40e4-b5da-7e3897be377e tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:28.785260 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-85569406-7616-40e4-b5da-7e3897be377e tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928" status: 200 len: 1684 microversion: 2.1 time: 0.156939 Sep 07 16:08:28.786108 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 554/1091] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:28 2022] GET /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928 => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:08:28.883611 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-03129f9f-b83e-4c78-ba2d-5ac9c62a5a67 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-162769224", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-415497108", "security_groups": [{"name": "tempest-secgroup-smoke-1506723329"}], "block_device_mapping_v2": [{"uuid": "b52735ab-1741-4bb1-899b-31c14d7590ba", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5051af4d-56b8-4439-b299-a2af35922776"}]}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:08:29.075611 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-03129f9f-b83e-4c78-ba2d-5ac9c62a5a67 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] validate_networks() for [('5051af4d-56b8-4439-b299-a2af35922776', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 16:08:29.348458 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-263e82eb-982a-4019-b54d-01c6ce098233 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:29.349162 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-263e82eb-982a-4019-b54d-01c6ce098233 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:29.355923 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-263e82eb-982a-4019-b54d-01c6ce098233 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:29.356464 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-263e82eb-982a-4019-b54d-01c6ce098233 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:29.356913 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-263e82eb-982a-4019-b54d-01c6ce098233 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:29.357887 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-263e82eb-982a-4019-b54d-01c6ce098233 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:29.358664 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-263e82eb-982a-4019-b54d-01c6ce098233 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:29.358664 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-263e82eb-982a-4019-b54d-01c6ce098233 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:29.504775 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-263e82eb-982a-4019-b54d-01c6ce098233 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aa615f2c7c4c6eaa694f551e38436a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266789e160554ec0a0a334304a0ad39d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:29.513484 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-263e82eb-982a-4019-b54d-01c6ce098233 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 200 len: 1271 microversion: 2.1 time: 0.169026 Sep 07 16:08:29.514044 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 555/1092] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:29 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 1271 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:08:29.534858 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-03129f9f-b83e-4c78-ba2d-5ac9c62a5a67 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 16:08:29.535326 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-03129f9f-b83e-4c78-ba2d-5ac9c62a5a67 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 16:08:29.535798 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-03129f9f-b83e-4c78-ba2d-5ac9c62a5a67 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 16:08:29.536491 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-03129f9f-b83e-4c78-ba2d-5ac9c62a5a67 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 16:08:29.536925 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-03129f9f-b83e-4c78-ba2d-5ac9c62a5a67 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 16:08:29.546287 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-03129f9f-b83e-4c78-ba2d-5ac9c62a5a67 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:29.546763 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-03129f9f-b83e-4c78-ba2d-5ac9c62a5a67 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:29.547180 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-03129f9f-b83e-4c78-ba2d-5ac9c62a5a67 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:29.547917 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-03129f9f-b83e-4c78-ba2d-5ac9c62a5a67 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:29.548368 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-03129f9f-b83e-4c78-ba2d-5ac9c62a5a67 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:29.548785 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-03129f9f-b83e-4c78-ba2d-5ac9c62a5a67 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:29.565632 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.quota [None req-03129f9f-b83e-4c78-ba2d-5ac9c62a5a67 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Getting quotas for project 6ef2c5a9809b4bee95a171cf6dca4e2b. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 16:08:29.570031 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.quota [None req-03129f9f-b83e-4c78-ba2d-5ac9c62a5a67 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Getting quotas for user d595f32b5f2d406b9d6ce62acec1456b and project 6ef2c5a9809b4bee95a171cf6dca4e2b. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 16:08:29.626025 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-03129f9f-b83e-4c78-ba2d-5ac9c62a5a67 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 16:08:29.628233 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-03129f9f-b83e-4c78-ba2d-5ac9c62a5a67 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 6631be10-20b4-46ba-acd7-f78070cf384d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b52735ab-1741-4bb1-899b-31c14d7590ba',volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 16:08:29.756634 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-03129f9f-b83e-4c78-ba2d-5ac9c62a5a67 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.876540 Sep 07 16:08:29.757267 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 538/1093] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Sep 7 16:08:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 879 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 16:08:29.768422 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7bf19228-7340-42f6-8b4b-438200c8c82b tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:29.769147 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7bf19228-7340-42f6-8b4b-438200c8c82b tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 6631be10-20b4-46ba-acd7-f78070cf384d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:29.809589 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-526cb684-2b98-40ac-8fd8-d2388ff0e906 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:29.810206 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-526cb684-2b98-40ac-8fd8-d2388ff0e906 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 8ae4d7f1-1422-4346-84ab-72682ad0a928] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:29.817172 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-526cb684-2b98-40ac-8fd8-d2388ff0e906 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:29.817662 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-526cb684-2b98-40ac-8fd8-d2388ff0e906 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:29.818725 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-526cb684-2b98-40ac-8fd8-d2388ff0e906 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:29.819425 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-526cb684-2b98-40ac-8fd8-d2388ff0e906 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:29.819918 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-526cb684-2b98-40ac-8fd8-d2388ff0e906 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:29.820353 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-526cb684-2b98-40ac-8fd8-d2388ff0e906 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:29.829353 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7bf19228-7340-42f6-8b4b-438200c8c82b tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:29.838647 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7bf19228-7340-42f6-8b4b-438200c8c82b tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d" status: 200 len: 1093 microversion: 2.1 time: 0.073962 Sep 07 16:08:29.839434 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 556/1094] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:29 2022] GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d => generated 1093 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 16:08:29.963718 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-526cb684-2b98-40ac-8fd8-d2388ff0e906 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:29.972460 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-526cb684-2b98-40ac-8fd8-d2388ff0e906 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928" status: 200 len: 1684 microversion: 2.1 time: 0.166197 Sep 07 16:08:29.973296 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 539/1095] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:29 2022] GET /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928 => generated 1684 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 16:08:30.536323 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a344f431-9b85-4bcd-8e84-6409f0df8c80 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:30.539473 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a344f431-9b85-4bcd-8e84-6409f0df8c80 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:30.546161 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a344f431-9b85-4bcd-8e84-6409f0df8c80 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:30.546648 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a344f431-9b85-4bcd-8e84-6409f0df8c80 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:30.547277 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a344f431-9b85-4bcd-8e84-6409f0df8c80 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:30.548170 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a344f431-9b85-4bcd-8e84-6409f0df8c80 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:30.548629 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a344f431-9b85-4bcd-8e84-6409f0df8c80 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:30.549081 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a344f431-9b85-4bcd-8e84-6409f0df8c80 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:30.696233 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a344f431-9b85-4bcd-8e84-6409f0df8c80 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aa615f2c7c4c6eaa694f551e38436a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266789e160554ec0a0a334304a0ad39d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:30.704539 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a344f431-9b85-4bcd-8e84-6409f0df8c80 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 200 len: 1259 microversion: 2.1 time: 0.172007 Sep 07 16:08:30.705115 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 557/1096] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:30 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 1259 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:08:30.719512 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-f7c90593-0254-47f8-996d-385d39bd5d8a req-262ef5d9-5ac7-4813-95a4-c4f223f922f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d25048e4-93d0-458e-bbe5-ba0a380f4b0c", "tag": "430afbde-c047-4cf7-8a6c-587bd546651c"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:08:30.730890 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-f7c90593-0254-47f8-996d-385d39bd5d8a req-262ef5d9-5ac7-4813-95a4-c4f223f922f5 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:30.731366 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-f7c90593-0254-47f8-996d-385d39bd5d8a req-262ef5d9-5ac7-4813-95a4-c4f223f922f5 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:30.731815 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-f7c90593-0254-47f8-996d-385d39bd5d8a req-262ef5d9-5ac7-4813-95a4-c4f223f922f5 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:30.747596 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-f7c90593-0254-47f8-996d-385d39bd5d8a req-262ef5d9-5ac7-4813-95a4-c4f223f922f5 service nova] Creating event network-changed:430afbde-c047-4cf7-8a6c-587bd546651c for instance d25048e4-93d0-458e-bbe5-ba0a380f4b0c on hv-cinder-85331 Sep 07 16:08:30.753841 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-f7c90593-0254-47f8-996d-385d39bd5d8a req-262ef5d9-5ac7-4813-95a4-c4f223f922f5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038069 Sep 07 16:08:30.754457 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 540/1097] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:08:30.869225 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-718d42f7-d8da-4224-b5fa-4d54ee450846 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:30.869888 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-718d42f7-d8da-4224-b5fa-4d54ee450846 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 6631be10-20b4-46ba-acd7-f78070cf384d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:30.875730 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-718d42f7-d8da-4224-b5fa-4d54ee450846 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:30.876210 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-718d42f7-d8da-4224-b5fa-4d54ee450846 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:30.876652 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-718d42f7-d8da-4224-b5fa-4d54ee450846 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:30.877336 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-718d42f7-d8da-4224-b5fa-4d54ee450846 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:30.877787 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-718d42f7-d8da-4224-b5fa-4d54ee450846 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:30.878238 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-718d42f7-d8da-4224-b5fa-4d54ee450846 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:30.938313 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-718d42f7-d8da-4224-b5fa-4d54ee450846 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:30.945742 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-718d42f7-d8da-4224-b5fa-4d54ee450846 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d" status: 200 len: 1191 microversion: 2.1 time: 0.081060 Sep 07 16:08:30.946300 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 558/1098] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:30 2022] GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d => generated 1191 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 16:08:30.998655 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-334e1a77-6bbc-4fec-85c7-6b1eac278d65 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:30.999357 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-334e1a77-6bbc-4fec-85c7-6b1eac278d65 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 8ae4d7f1-1422-4346-84ab-72682ad0a928] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:31.005550 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-334e1a77-6bbc-4fec-85c7-6b1eac278d65 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:31.006027 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-334e1a77-6bbc-4fec-85c7-6b1eac278d65 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:31.006472 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-334e1a77-6bbc-4fec-85c7-6b1eac278d65 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:31.007155 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-334e1a77-6bbc-4fec-85c7-6b1eac278d65 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:31.007643 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-334e1a77-6bbc-4fec-85c7-6b1eac278d65 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:31.008068 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-334e1a77-6bbc-4fec-85c7-6b1eac278d65 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:31.135226 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-334e1a77-6bbc-4fec-85c7-6b1eac278d65 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:31.143169 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-334e1a77-6bbc-4fec-85c7-6b1eac278d65 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928" status: 200 len: 1684 microversion: 2.1 time: 0.148737 Sep 07 16:08:31.143755 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 541/1099] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:30 2022] GET /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928 => generated 1684 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:08:31.730217 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c6438e47-dae9-4b77-b790-58d44d58c217 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:31.732278 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c6438e47-dae9-4b77-b790-58d44d58c217 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:31.740296 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6438e47-dae9-4b77-b790-58d44d58c217 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:31.741353 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6438e47-dae9-4b77-b790-58d44d58c217 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:31.742011 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6438e47-dae9-4b77-b790-58d44d58c217 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:31.744452 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6438e47-dae9-4b77-b790-58d44d58c217 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:31.745160 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6438e47-dae9-4b77-b790-58d44d58c217 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:31.745916 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6438e47-dae9-4b77-b790-58d44d58c217 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:31.968534 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d49597c6-e653-4632-8371-7e377b389cea tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:31.969746 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d49597c6-e653-4632-8371-7e377b389cea tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 6631be10-20b4-46ba-acd7-f78070cf384d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:31.977473 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d49597c6-e653-4632-8371-7e377b389cea tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:31.977962 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d49597c6-e653-4632-8371-7e377b389cea tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:31.978576 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d49597c6-e653-4632-8371-7e377b389cea tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:31.979465 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d49597c6-e653-4632-8371-7e377b389cea tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:31.979970 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d49597c6-e653-4632-8371-7e377b389cea tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:31.980400 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d49597c6-e653-4632-8371-7e377b389cea tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:32.032812 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c6438e47-dae9-4b77-b790-58d44d58c217 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aa615f2c7c4c6eaa694f551e38436a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266789e160554ec0a0a334304a0ad39d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:32.042679 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c6438e47-dae9-4b77-b790-58d44d58c217 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 200 len: 1259 microversion: 2.1 time: 0.317745 Sep 07 16:08:32.043909 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 559/1100] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:31 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 1259 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:08:32.063915 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-d49597c6-e653-4632-8371-7e377b389cea tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:32.073349 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d49597c6-e653-4632-8371-7e377b389cea tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d" status: 200 len: 1209 microversion: 2.1 time: 0.108686 Sep 07 16:08:32.075008 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 542/1101] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:31 2022] GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d => generated 1209 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 16:08:32.168133 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0183c999-3af8-44c7-a01d-81cfbd883cc5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:32.171862 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0183c999-3af8-44c7-a01d-81cfbd883cc5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 8ae4d7f1-1422-4346-84ab-72682ad0a928] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:32.182682 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0183c999-3af8-44c7-a01d-81cfbd883cc5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:32.183825 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0183c999-3af8-44c7-a01d-81cfbd883cc5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:32.184431 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0183c999-3af8-44c7-a01d-81cfbd883cc5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:32.185282 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0183c999-3af8-44c7-a01d-81cfbd883cc5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:32.185885 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0183c999-3af8-44c7-a01d-81cfbd883cc5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:32.186460 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0183c999-3af8-44c7-a01d-81cfbd883cc5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:32.285731 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-0183c999-3af8-44c7-a01d-81cfbd883cc5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:32.294972 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0183c999-3af8-44c7-a01d-81cfbd883cc5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928" status: 200 len: 1616 microversion: 2.1 time: 0.132422 Sep 07 16:08:32.296475 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 560/1102] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:32 2022] GET /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928 => generated 1616 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:08:32.542326 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-adea4f22-df77-4a45-bdfe-f745b18ce7c3 req-5e6bda28-b475-4043-a968-f27b11eacf94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ae4d7f1-1422-4346-84ab-72682ad0a928", "name": "network-vif-deleted", "tag": "564cc98f-00eb-466c-b68e-33eaa3b07be5"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:08:32.590524 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-adea4f22-df77-4a45-bdfe-f745b18ce7c3 req-5e6bda28-b475-4043-a968-f27b11eacf94 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:32.591761 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-adea4f22-df77-4a45-bdfe-f745b18ce7c3 req-5e6bda28-b475-4043-a968-f27b11eacf94 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:32.592739 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-adea4f22-df77-4a45-bdfe-f745b18ce7c3 req-5e6bda28-b475-4043-a968-f27b11eacf94 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:32.609128 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-adea4f22-df77-4a45-bdfe-f745b18ce7c3 req-5e6bda28-b475-4043-a968-f27b11eacf94 service nova] Creating event network-vif-deleted:564cc98f-00eb-466c-b68e-33eaa3b07be5 for instance 8ae4d7f1-1422-4346-84ab-72682ad0a928 on hv-cinder-85331 Sep 07 16:08:32.616418 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-adea4f22-df77-4a45-bdfe-f745b18ce7c3 req-5e6bda28-b475-4043-a968-f27b11eacf94 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160919 Sep 07 16:08:32.617706 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 543/1103] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:08:33.068170 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-921311a6-38d6-41bc-bfbd-7080fc7406e8 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:33.069050 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-921311a6-38d6-41bc-bfbd-7080fc7406e8 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:33.077536 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-921311a6-38d6-41bc-bfbd-7080fc7406e8 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:33.078106 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-921311a6-38d6-41bc-bfbd-7080fc7406e8 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:33.078574 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-921311a6-38d6-41bc-bfbd-7080fc7406e8 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:33.079355 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-921311a6-38d6-41bc-bfbd-7080fc7406e8 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:33.079939 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-921311a6-38d6-41bc-bfbd-7080fc7406e8 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:33.081374 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-921311a6-38d6-41bc-bfbd-7080fc7406e8 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:33.103443 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e9f54e46-bce0-4394-bb16-91dadf53ceff tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:33.104023 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e9f54e46-bce0-4394-bb16-91dadf53ceff tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 6631be10-20b4-46ba-acd7-f78070cf384d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:33.107398 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:08:33.117740 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e9f54e46-bce0-4394-bb16-91dadf53ceff tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:33.118245 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e9f54e46-bce0-4394-bb16-91dadf53ceff tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:33.118764 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e9f54e46-bce0-4394-bb16-91dadf53ceff tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:33.119562 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e9f54e46-bce0-4394-bb16-91dadf53ceff tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:33.120058 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e9f54e46-bce0-4394-bb16-91dadf53ceff tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:33.120478 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e9f54e46-bce0-4394-bb16-91dadf53ceff tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:33.393834 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-921311a6-38d6-41bc-bfbd-7080fc7406e8 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aa615f2c7c4c6eaa694f551e38436a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266789e160554ec0a0a334304a0ad39d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:33.405125 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-e9f54e46-bce0-4394-bb16-91dadf53ceff tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:33.408494 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-921311a6-38d6-41bc-bfbd-7080fc7406e8 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 200 len: 1259 microversion: 2.1 time: 0.344777 Sep 07 16:08:33.409249 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 561/1104] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:33 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 1259 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:08:33.414020 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e9f54e46-bce0-4394-bb16-91dadf53ceff tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d" status: 200 len: 1277 microversion: 2.1 time: 0.321011 Sep 07 16:08:33.414388 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-ddba5919-bf2e-4925-adfe-5422442f00d3 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:33.428406 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-ddba5919-bf2e-4925-adfe-5422442f00d3 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 8ae4d7f1-1422-4346-84ab-72682ad0a928] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:33.431725 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 544/1105] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:33 2022] GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d => generated 1277 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 16:08:33.441695 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ddba5919-bf2e-4925-adfe-5422442f00d3 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:33.443930 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ddba5919-bf2e-4925-adfe-5422442f00d3 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:33.445364 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ddba5919-bf2e-4925-adfe-5422442f00d3 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:33.446179 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ddba5919-bf2e-4925-adfe-5422442f00d3 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:33.448208 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ddba5919-bf2e-4925-adfe-5422442f00d3 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:33.450329 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ddba5919-bf2e-4925-adfe-5422442f00d3 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:33.507649 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ddba5919-bf2e-4925-adfe-5422442f00d3 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:33.508573 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ddba5919-bf2e-4925-adfe-5422442f00d3 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:33.509364 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-ddba5919-bf2e-4925-adfe-5422442f00d3 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:33.510029 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-ddba5919-bf2e-4925-adfe-5422442f00d3 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lazy-loading 'fault' on Instance uuid 8ae4d7f1-1422-4346-84ab-72682ad0a928 {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 16:08:33.583738 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-ddba5919-bf2e-4925-adfe-5422442f00d3 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:33.593046 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-ddba5919-bf2e-4925-adfe-5422442f00d3 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928" status: 200 len: 1332 microversion: 2.1 time: 0.182532 Sep 07 16:08:33.604477 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 562/1106] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:33 2022] GET /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928 => generated 1332 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:08:34.277594 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-ec07baef-85b1-48d9-b565-a672a9faaa0d req-059271d2-546d-43ef-b168-983b89725ddd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6631be10-20b4-46ba-acd7-f78070cf384d", "tag": "967b7d4c-12d8-4ab7-bdab-2c385d5d8e50"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:08:34.288260 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-ec07baef-85b1-48d9-b565-a672a9faaa0d req-059271d2-546d-43ef-b168-983b89725ddd service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:34.288737 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-ec07baef-85b1-48d9-b565-a672a9faaa0d req-059271d2-546d-43ef-b168-983b89725ddd service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:34.289164 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-ec07baef-85b1-48d9-b565-a672a9faaa0d req-059271d2-546d-43ef-b168-983b89725ddd service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:34.300265 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-ec07baef-85b1-48d9-b565-a672a9faaa0d req-059271d2-546d-43ef-b168-983b89725ddd service nova] Creating event network-changed:967b7d4c-12d8-4ab7-bdab-2c385d5d8e50 for instance 6631be10-20b4-46ba-acd7-f78070cf384d on hv-cinder-85331 Sep 07 16:08:34.305687 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-ec07baef-85b1-48d9-b565-a672a9faaa0d req-059271d2-546d-43ef-b168-983b89725ddd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037035 Sep 07 16:08:34.306271 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 545/1107] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:08:34.436121 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f8882496-f942-46cf-943b-161f915c72b5 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:34.437118 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f8882496-f942-46cf-943b-161f915c72b5 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:34.440613 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b89f9453-814e-4ad0-985a-2d0263d47e5d tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:34.441164 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b89f9453-814e-4ad0-985a-2d0263d47e5d tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 6631be10-20b4-46ba-acd7-f78070cf384d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:34.444367 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8882496-f942-46cf-943b-161f915c72b5 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:34.444926 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8882496-f942-46cf-943b-161f915c72b5 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:34.445585 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8882496-f942-46cf-943b-161f915c72b5 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:34.446351 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8882496-f942-46cf-943b-161f915c72b5 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:34.446990 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8882496-f942-46cf-943b-161f915c72b5 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:34.447479 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8882496-f942-46cf-943b-161f915c72b5 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:34.448299 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b89f9453-814e-4ad0-985a-2d0263d47e5d tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:34.448785 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b89f9453-814e-4ad0-985a-2d0263d47e5d tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:34.449223 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b89f9453-814e-4ad0-985a-2d0263d47e5d tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:34.449919 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b89f9453-814e-4ad0-985a-2d0263d47e5d tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:34.450381 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b89f9453-814e-4ad0-985a-2d0263d47e5d tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:34.450806 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b89f9453-814e-4ad0-985a-2d0263d47e5d tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:34.586568 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f8882496-f942-46cf-943b-161f915c72b5 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aa615f2c7c4c6eaa694f551e38436a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266789e160554ec0a0a334304a0ad39d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:34.594292 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f8882496-f942-46cf-943b-161f915c72b5 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 200 len: 1259 microversion: 2.1 time: 0.162138 Sep 07 16:08:34.594855 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 563/1108] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:34 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:08:34.618591 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-00c4a1b8-8192-4e5e-b25b-790af9899601 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:34.619368 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-00c4a1b8-8192-4e5e-b25b-790af9899601 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 8ae4d7f1-1422-4346-84ab-72682ad0a928] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:34.625269 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-00c4a1b8-8192-4e5e-b25b-790af9899601 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:34.625688 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-00c4a1b8-8192-4e5e-b25b-790af9899601 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:34.626127 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-00c4a1b8-8192-4e5e-b25b-790af9899601 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:34.627044 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-00c4a1b8-8192-4e5e-b25b-790af9899601 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:34.627496 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-00c4a1b8-8192-4e5e-b25b-790af9899601 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:34.627947 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-00c4a1b8-8192-4e5e-b25b-790af9899601 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:34.641509 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-00c4a1b8-8192-4e5e-b25b-790af9899601 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] HTTP exception thrown: Instance 8ae4d7f1-1422-4346-84ab-72682ad0a928 could not be found. Sep 07 16:08:34.643170 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-00c4a1b8-8192-4e5e-b25b-790af9899601 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Request method failure captured: Sep 07 16:08:34.643170 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928 HTTP/1.1 Sep 07 16:08:34.643170 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept: application/json Sep 07 16:08:34.643170 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Sep 07 16:08:34.643170 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Connection: close Sep 07 16:08:34.643170 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Length: 0 Sep 07 16:08:34.643170 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Type: application/json Sep 07 16:08:34.643170 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Host: 10.222.0.17 Sep 07 16:08:34.643170 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Sep 07 16:08:34.643170 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Sep 07 16:08:34.643170 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjGMEEfdw4OUg2B39RKswOmT5z54ISjPs9Ys-pBh0gUFq_XPVQCzkiphko1MTfezgc9xGOiE9M4-fp-aoq8efmnODenpErT0vQYyVQWrBzaRRoo-wl5i6l7H-bvKljvP6w5U1cAwX2okeVPnYRC9X59Bw9YuV07_v6iRyvOmKt9QO33DU Sep 07 16:08:34.643170 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Sep 07 16:08:34.643170 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Sep 07 16:08:34.643170 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Sep 07 16:08:34.643170 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Sep 07 16:08:34.643170 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Sep 07 16:08:34.643170 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Sep 07 16:08:34.643170 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Id: ab1963a1a6684af58f5c240787788b60 Sep 07 16:08:34.643170 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-AttachVolumeNegativeTest-857872657 Sep 07 16:08:34.643170 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Role: reader,member Sep 07 16:08:34.643170 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Roles: reader,member Sep 07 16:08:34.644885 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ab1963a1a6684af58f5c240787788b60", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ab1963a1a6684af58f5c240787788b60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ab1963a1a6684af58f5c240787788b60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ab1963a1a6684af58f5c240787788b60"}]}] Sep 07 16:08:34.644885 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-AttachVolumeNegativeTest-857872657 Sep 07 16:08:34.644885 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Id: ab1963a1a6684af58f5c240787788b60 Sep 07 16:08:34.644885 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-857872657 Sep 07 16:08:34.644885 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User: tempest-AttachVolumeNegativeTest-857872657-project Sep 07 16:08:34.644885 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Sep 07 16:08:34.644885 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Sep 07 16:08:34.644885 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Id: 2dab44e593194fe788216b029eecd10c Sep 07 16:08:34.644885 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-AttachVolumeNegativeTest-857872657-project Sep 07 16:08:34.644885 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: method: > Sep 07 16:08:34.644885 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: exception: Instance 8ae4d7f1-1422-4346-84ab-72682ad0a928 could not be found. Sep 07 16:08:34.644885 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: action_args: {'id': '8ae4d7f1-1422-4346-84ab-72682ad0a928'} Sep 07 16:08:34.645867 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 16:08:34.645867 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:08:34.645867 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 16:08:34.645867 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 16:08:34.645867 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 16:08:34.645867 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 16:08:34.645867 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 16:08:34.645867 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 16:08:34.645867 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 16:08:34.645867 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 16:08:34.645867 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ae4d7f1-1422-4346-84ab-72682ad0a928 could not be found. Sep 07 16:08:34.645867 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:08:34.645867 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:08:34.645867 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:08:34.645867 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:08:34.645867 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:08:34.645867 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:08:34.645867 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 16:08:34.645867 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 16:08:34.645867 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 16:08:34.647388 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 16:08:34.647388 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 16:08:34.647388 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 16:08:34.647388 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 16:08:34.647388 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 16:08:34.647388 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 16:08:34.647388 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 16:08:34.647388 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ae4d7f1-1422-4346-84ab-72682ad0a928 could not be found. Sep 07 16:08:34.647388 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:08:34.647388 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:08:34.647388 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:08:34.647388 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:08:34.647388 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:08:34.647388 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:08:34.647388 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 16:08:34.647388 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 16:08:34.647388 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ae4d7f1-1422-4346-84ab-72682ad0a928 could not be found. Sep 07 16:08:34.647388 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:08:34.648790 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-00c4a1b8-8192-4e5e-b25b-790af9899601 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Returning 404 to user: Instance 8ae4d7f1-1422-4346-84ab-72682ad0a928 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 16:08:34.648790 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-00c4a1b8-8192-4e5e-b25b-790af9899601 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928" status: 404 len: 111 microversion: 2.1 time: 0.030409 Sep 07 16:08:34.648790 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 564/1109] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:34 2022] GET /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 16:08:34.657390 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9d920a21-e223-4657-868b-ac162b6b1427 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '.version_select at 0x7ff9a94e0a60>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:34.677159 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9d920a21-e223-4657-868b-ac162b6b1427 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1700250870" status: 202 len: 0 microversion: 2.1 time: 0.023463 Sep 07 16:08:34.678438 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 565/1110] 10.222.0.17 () {58 vars in 1221 bytes} [Wed Sep 7 16:08:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1700250870 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 16:08:34.687477 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-b89f9453-814e-4ad0-985a-2d0263d47e5d tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:34.695414 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b89f9453-814e-4ad0-985a-2d0263d47e5d tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d" status: 200 len: 1265 microversion: 2.1 time: 0.259451 Sep 07 16:08:34.696225 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 546/1111] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:34 2022] GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d => generated 1265 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 16:08:35.286050 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-281d460e-1a75-46a7-95e7-77f77c1da1ee tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Action: 'create', calling method: .version_select at 0x7ff9a5cd3e50>, body: {"keypair": {"name": "tempest-keypair-1715222224", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBajLJYLAeU8PAaUStdfRKFrQ0nZ+pNz4pMZ6ij2z85BMgqWPClNie/RzY6Uin32RXSGcfOHxCr+5gOK5WdIGmGpoNBcZKCkKDSFSZF39j4qgHcEsb1IFhQvybpkUjvZ0A=="}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:08:35.302272 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-281d460e-1a75-46a7-95e7-77f77c1da1ee tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Getting quotas for project ab1963a1a6684af58f5c240787788b60. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 16:08:35.305987 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-281d460e-1a75-46a7-95e7-77f77c1da1ee tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Getting quotas for user 2dab44e593194fe788216b029eecd10c and project ab1963a1a6684af58f5c240787788b60. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 16:08:35.326383 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-281d460e-1a75-46a7-95e7-77f77c1da1ee tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044236 Sep 07 16:08:35.326948 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 566/1112] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Sep 7 16:08:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:08:35.617511 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-89a89a71-9d28-4223-bb55-5e1c2c613a62 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:35.618224 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-89a89a71-9d28-4223-bb55-5e1c2c613a62 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:35.624983 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89a89a71-9d28-4223-bb55-5e1c2c613a62 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:35.625556 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89a89a71-9d28-4223-bb55-5e1c2c613a62 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:35.625991 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89a89a71-9d28-4223-bb55-5e1c2c613a62 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:35.626716 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89a89a71-9d28-4223-bb55-5e1c2c613a62 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:35.627211 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89a89a71-9d28-4223-bb55-5e1c2c613a62 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:35.627629 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-89a89a71-9d28-4223-bb55-5e1c2c613a62 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:35.632755 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:08:35.718620 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3fae718e-dd8f-42af-83bd-4b86f9c43a66 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:35.719380 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3fae718e-dd8f-42af-83bd-4b86f9c43a66 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 6631be10-20b4-46ba-acd7-f78070cf384d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:35.726217 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3fae718e-dd8f-42af-83bd-4b86f9c43a66 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:35.726947 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3fae718e-dd8f-42af-83bd-4b86f9c43a66 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:35.727487 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3fae718e-dd8f-42af-83bd-4b86f9c43a66 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:35.728311 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3fae718e-dd8f-42af-83bd-4b86f9c43a66 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:35.728863 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3fae718e-dd8f-42af-83bd-4b86f9c43a66 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:35.729378 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3fae718e-dd8f-42af-83bd-4b86f9c43a66 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:35.773674 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-89a89a71-9d28-4223-bb55-5e1c2c613a62 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aa615f2c7c4c6eaa694f551e38436a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266789e160554ec0a0a334304a0ad39d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:35.781812 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-89a89a71-9d28-4223-bb55-5e1c2c613a62 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 200 len: 1259 microversion: 2.1 time: 0.168103 Sep 07 16:08:35.782390 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 547/1113] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:35 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:08:35.928530 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3fae718e-dd8f-42af-83bd-4b86f9c43a66 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:35.936197 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3fae718e-dd8f-42af-83bd-4b86f9c43a66 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d" status: 200 len: 1265 microversion: 2.1 time: 0.221911 Sep 07 16:08:35.936746 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 567/1114] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:35 2022] GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d => generated 1265 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 16:08:36.805369 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-82a42ba3-8763-4255-b8ac-dfaed9de770f tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:36.806065 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-82a42ba3-8763-4255-b8ac-dfaed9de770f tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:36.813025 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-82a42ba3-8763-4255-b8ac-dfaed9de770f tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:36.813510 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-82a42ba3-8763-4255-b8ac-dfaed9de770f tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:36.814083 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-82a42ba3-8763-4255-b8ac-dfaed9de770f tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:36.814774 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-82a42ba3-8763-4255-b8ac-dfaed9de770f tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:36.815226 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-82a42ba3-8763-4255-b8ac-dfaed9de770f tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:36.815776 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-82a42ba3-8763-4255-b8ac-dfaed9de770f tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:36.901192 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cd97449a-bd3c-41f0-b9cb-11d727d24613 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1907355264", "imageRef": "cfe19284-9779-46f4-b458-81d5475ec82f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "de0a3fba-a9f9-45bf-aa74-cb5014a191cb"}], "security_groups": [{"name": "tempest-securitygroup--2007087899"}], "key_name": "tempest-keypair-1715222224", "user_data": "}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:08:36.942003 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:08:36.949862 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-82a42ba3-8763-4255-b8ac-dfaed9de770f tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aa615f2c7c4c6eaa694f551e38436a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266789e160554ec0a0a334304a0ad39d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:36.957986 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-82a42ba3-8763-4255-b8ac-dfaed9de770f tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 200 len: 1259 microversion: 2.1 time: 0.156702 Sep 07 16:08:36.959128 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 548/1115] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:36 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:08:36.963778 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f9550e0c-3463-4281-98bd-3d2c3dbbd563 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:36.964573 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f9550e0c-3463-4281-98bd-3d2c3dbbd563 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 6631be10-20b4-46ba-acd7-f78070cf384d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:36.970320 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f9550e0c-3463-4281-98bd-3d2c3dbbd563 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:36.970801 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f9550e0c-3463-4281-98bd-3d2c3dbbd563 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:36.971229 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f9550e0c-3463-4281-98bd-3d2c3dbbd563 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:36.972196 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f9550e0c-3463-4281-98bd-3d2c3dbbd563 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:36.972644 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f9550e0c-3463-4281-98bd-3d2c3dbbd563 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:36.973061 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f9550e0c-3463-4281-98bd-3d2c3dbbd563 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:37.004940 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.network.neutron [None req-cd97449a-bd3c-41f0-b9cb-11d727d24613 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] validate_networks() for [('de0a3fba-a9f9-45bf-aa74-cb5014a191cb', None, None, None, None, None)] {{(pid=120640) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 16:08:37.101613 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-f9550e0c-3463-4281-98bd-3d2c3dbbd563 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:37.109302 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f9550e0c-3463-4281-98bd-3d2c3dbbd563 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d" status: 200 len: 1265 microversion: 2.1 time: 0.149221 Sep 07 16:08:37.109871 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 549/1116] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:36 2022] GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:08:37.375103 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-cd97449a-bd3c-41f0-b9cb-11d727d24613 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Flavor limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 16:08:37.375531 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-cd97449a-bd3c-41f0-b9cb-11d727d24613 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Image limits 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 16:08:37.376036 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-cd97449a-bd3c-41f0-b9cb-11d727d24613 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Flavor pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 16:08:37.376448 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-cd97449a-bd3c-41f0-b9cb-11d727d24613 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Image pref 0:0:0 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 16:08:37.376889 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.virt.hardware [None req-cd97449a-bd3c-41f0-b9cb-11d727d24613 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120640) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 16:08:37.386106 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd97449a-bd3c-41f0-b9cb-11d727d24613 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:37.386586 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd97449a-bd3c-41f0-b9cb-11d727d24613 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:37.387023 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd97449a-bd3c-41f0-b9cb-11d727d24613 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:37.387779 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd97449a-bd3c-41f0-b9cb-11d727d24613 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:37.388234 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd97449a-bd3c-41f0-b9cb-11d727d24613 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:37.388661 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cd97449a-bd3c-41f0-b9cb-11d727d24613 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:37.405566 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-cd97449a-bd3c-41f0-b9cb-11d727d24613 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Getting quotas for project ab1963a1a6684af58f5c240787788b60. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 16:08:37.408282 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:08:37.410534 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-cd97449a-bd3c-41f0-b9cb-11d727d24613 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Getting quotas for user 2dab44e593194fe788216b029eecd10c and project ab1963a1a6684af58f5c240787788b60. Resources: {'cores', 'instances', 'ram'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 16:08:37.423850 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cd97449a-bd3c-41f0-b9cb-11d727d24613 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Going to run 1 instances... {{(pid=120640) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 16:08:37.425962 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cd97449a-bd3c-41f0-b9cb-11d727d24613 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 423140e3-a552-44fd-969a-7d215a453863] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cfe19284-9779-46f4-b458-81d5475ec82f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120640) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 16:08:37.477241 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cd97449a-bd3c-41f0-b9cb-11d727d24613 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.581054 Sep 07 16:08:37.478202 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 568/1117] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Sep 7 16:08:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 07 16:08:37.490165 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9e1819e3-eff3-4751-8244-f7b0d44e663f tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:37.490774 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9e1819e3-eff3-4751-8244-f7b0d44e663f tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 423140e3-a552-44fd-969a-7d215a453863] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:37.542860 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-9e1819e3-eff3-4751-8244-f7b0d44e663f tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:37.550771 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9e1819e3-eff3-4751-8244-f7b0d44e663f tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863" status: 200 len: 1242 microversion: 2.1 time: 0.065000 Sep 07 16:08:37.551537 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 550/1118] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:37 2022] GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863 => generated 1242 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:08:37.981281 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-787deb8d-080d-4460-897e-b67d241ca714 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:37.981898 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-787deb8d-080d-4460-897e-b67d241ca714 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:37.988735 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-787deb8d-080d-4460-897e-b67d241ca714 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:37.989217 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-787deb8d-080d-4460-897e-b67d241ca714 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:37.990222 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-787deb8d-080d-4460-897e-b67d241ca714 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:37.990908 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-787deb8d-080d-4460-897e-b67d241ca714 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:37.991368 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-787deb8d-080d-4460-897e-b67d241ca714 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:37.991826 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-787deb8d-080d-4460-897e-b67d241ca714 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:38.123095 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-787deb8d-080d-4460-897e-b67d241ca714 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aa615f2c7c4c6eaa694f551e38436a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266789e160554ec0a0a334304a0ad39d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:38.130941 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-787deb8d-080d-4460-897e-b67d241ca714 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 200 len: 1259 microversion: 2.1 time: 0.153548 Sep 07 16:08:38.131491 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-240563e0-c7a2-456c-b814-c9ee1d2baf24 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:38.131972 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 569/1119] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:37 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:08:38.132250 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-240563e0-c7a2-456c-b814-c9ee1d2baf24 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 6631be10-20b4-46ba-acd7-f78070cf384d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:38.138103 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-240563e0-c7a2-456c-b814-c9ee1d2baf24 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:38.138580 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-240563e0-c7a2-456c-b814-c9ee1d2baf24 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:38.139011 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-240563e0-c7a2-456c-b814-c9ee1d2baf24 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:38.139726 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-240563e0-c7a2-456c-b814-c9ee1d2baf24 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:38.140185 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-240563e0-c7a2-456c-b814-c9ee1d2baf24 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:38.140606 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-240563e0-c7a2-456c-b814-c9ee1d2baf24 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:38.270362 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-240563e0-c7a2-456c-b814-c9ee1d2baf24 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:38.278477 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-240563e0-c7a2-456c-b814-c9ee1d2baf24 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d" status: 200 len: 1265 microversion: 2.1 time: 0.150898 Sep 07 16:08:38.279039 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 551/1120] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:38 2022] GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 16:08:38.578077 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6915177f-7516-412d-8b5e-090324eb8c85 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:38.578679 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6915177f-7516-412d-8b5e-090324eb8c85 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 423140e3-a552-44fd-969a-7d215a453863] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:38.585224 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6915177f-7516-412d-8b5e-090324eb8c85 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:38.585786 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6915177f-7516-412d-8b5e-090324eb8c85 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:38.586246 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6915177f-7516-412d-8b5e-090324eb8c85 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:38.586925 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6915177f-7516-412d-8b5e-090324eb8c85 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:38.587374 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6915177f-7516-412d-8b5e-090324eb8c85 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:38.587815 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6915177f-7516-412d-8b5e-090324eb8c85 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:38.647743 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6915177f-7516-412d-8b5e-090324eb8c85 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:38.655122 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6915177f-7516-412d-8b5e-090324eb8c85 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863" status: 200 len: 1246 microversion: 2.1 time: 0.080945 Sep 07 16:08:38.655689 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 570/1121] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:38 2022] GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863 => generated 1246 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:08:39.153483 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a2587730-9cfc-4d1b-931a-de37bc94c32e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:39.154029 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a2587730-9cfc-4d1b-931a-de37bc94c32e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:39.160522 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a2587730-9cfc-4d1b-931a-de37bc94c32e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:39.161005 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a2587730-9cfc-4d1b-931a-de37bc94c32e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:39.161971 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a2587730-9cfc-4d1b-931a-de37bc94c32e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:39.162664 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a2587730-9cfc-4d1b-931a-de37bc94c32e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:39.163115 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a2587730-9cfc-4d1b-931a-de37bc94c32e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:39.163554 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a2587730-9cfc-4d1b-931a-de37bc94c32e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:39.293815 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-a2587730-9cfc-4d1b-931a-de37bc94c32e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aa615f2c7c4c6eaa694f551e38436a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266789e160554ec0a0a334304a0ad39d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:39.301245 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e321aee4-8573-4a51-bdeb-f4466ecbf198 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:39.301912 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e321aee4-8573-4a51-bdeb-f4466ecbf198 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 6631be10-20b4-46ba-acd7-f78070cf384d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:39.302581 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a2587730-9cfc-4d1b-931a-de37bc94c32e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 200 len: 1259 microversion: 2.1 time: 0.152427 Sep 07 16:08:39.303027 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 552/1122] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:39 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:08:39.309189 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e321aee4-8573-4a51-bdeb-f4466ecbf198 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:39.309738 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e321aee4-8573-4a51-bdeb-f4466ecbf198 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:39.310235 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e321aee4-8573-4a51-bdeb-f4466ecbf198 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:39.310978 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e321aee4-8573-4a51-bdeb-f4466ecbf198 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:39.311430 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e321aee4-8573-4a51-bdeb-f4466ecbf198 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:39.312004 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e321aee4-8573-4a51-bdeb-f4466ecbf198 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:39.453957 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e321aee4-8573-4a51-bdeb-f4466ecbf198 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:39.461819 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e321aee4-8573-4a51-bdeb-f4466ecbf198 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d" status: 200 len: 1265 microversion: 2.1 time: 0.164332 Sep 07 16:08:39.462379 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 571/1123] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:39 2022] GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 16:08:39.676751 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-78f2e76e-7107-498d-975d-f22951ae2f45 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:39.677437 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-78f2e76e-7107-498d-975d-f22951ae2f45 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 423140e3-a552-44fd-969a-7d215a453863] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:39.679593 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:08:39.684925 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78f2e76e-7107-498d-975d-f22951ae2f45 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:39.685409 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78f2e76e-7107-498d-975d-f22951ae2f45 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:39.685845 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78f2e76e-7107-498d-975d-f22951ae2f45 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:39.686529 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78f2e76e-7107-498d-975d-f22951ae2f45 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:39.686982 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78f2e76e-7107-498d-975d-f22951ae2f45 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:39.687403 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78f2e76e-7107-498d-975d-f22951ae2f45 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:39.746534 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-78f2e76e-7107-498d-975d-f22951ae2f45 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:39.754118 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-78f2e76e-7107-498d-975d-f22951ae2f45 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863" status: 200 len: 1246 microversion: 2.1 time: 0.081253 Sep 07 16:08:39.754675 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 553/1124] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:39 2022] GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863 => generated 1246 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:08:40.324767 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c54dfdb8-1f34-4d21-a938-e27d64d2b70b tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:40.325375 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c54dfdb8-1f34-4d21-a938-e27d64d2b70b tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:40.331811 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c54dfdb8-1f34-4d21-a938-e27d64d2b70b tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:40.332295 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c54dfdb8-1f34-4d21-a938-e27d64d2b70b tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:40.332727 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c54dfdb8-1f34-4d21-a938-e27d64d2b70b tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:40.333964 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c54dfdb8-1f34-4d21-a938-e27d64d2b70b tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:40.334357 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c54dfdb8-1f34-4d21-a938-e27d64d2b70b tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:40.334774 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c54dfdb8-1f34-4d21-a938-e27d64d2b70b tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:40.462020 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c54dfdb8-1f34-4d21-a938-e27d64d2b70b tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aa615f2c7c4c6eaa694f551e38436a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266789e160554ec0a0a334304a0ad39d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:40.469788 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c54dfdb8-1f34-4d21-a938-e27d64d2b70b tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 200 len: 1259 microversion: 2.1 time: 0.148877 Sep 07 16:08:40.470419 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 572/1125] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:40 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:08:40.485368 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8839495f-04a5-48d2-a78a-7674ce189417 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:40.486089 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8839495f-04a5-48d2-a78a-7674ce189417 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 6631be10-20b4-46ba-acd7-f78070cf384d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:40.492566 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8839495f-04a5-48d2-a78a-7674ce189417 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:40.493053 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8839495f-04a5-48d2-a78a-7674ce189417 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:40.493493 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8839495f-04a5-48d2-a78a-7674ce189417 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:40.494184 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8839495f-04a5-48d2-a78a-7674ce189417 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:40.494639 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8839495f-04a5-48d2-a78a-7674ce189417 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:40.495064 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8839495f-04a5-48d2-a78a-7674ce189417 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:40.633052 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-8839495f-04a5-48d2-a78a-7674ce189417 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:40.640703 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8839495f-04a5-48d2-a78a-7674ce189417 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d" status: 200 len: 1265 microversion: 2.1 time: 0.159194 Sep 07 16:08:40.641240 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 554/1126] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:40 2022] GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:08:40.777092 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-92a23f6c-2043-4bd2-82e9-ac612bf7b163 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:40.777698 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-92a23f6c-2043-4bd2-82e9-ac612bf7b163 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 423140e3-a552-44fd-969a-7d215a453863] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:40.783636 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92a23f6c-2043-4bd2-82e9-ac612bf7b163 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:40.784111 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92a23f6c-2043-4bd2-82e9-ac612bf7b163 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:40.784539 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92a23f6c-2043-4bd2-82e9-ac612bf7b163 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:40.785215 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92a23f6c-2043-4bd2-82e9-ac612bf7b163 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:40.785689 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92a23f6c-2043-4bd2-82e9-ac612bf7b163 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:40.786108 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-92a23f6c-2043-4bd2-82e9-ac612bf7b163 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:40.845702 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-92a23f6c-2043-4bd2-82e9-ac612bf7b163 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:40.853490 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-92a23f6c-2043-4bd2-82e9-ac612bf7b163 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863" status: 200 len: 1246 microversion: 2.1 time: 0.080254 Sep 07 16:08:40.853984 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 573/1127] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:40 2022] GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863 => generated 1246 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:08:41.493564 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-1d28c119-f172-49b1-a76e-1d5fc7d641d2 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:41.494161 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-1d28c119-f172-49b1-a76e-1d5fc7d641d2 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:41.500794 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1d28c119-f172-49b1-a76e-1d5fc7d641d2 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:41.501279 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1d28c119-f172-49b1-a76e-1d5fc7d641d2 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:41.501716 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1d28c119-f172-49b1-a76e-1d5fc7d641d2 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:41.502405 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1d28c119-f172-49b1-a76e-1d5fc7d641d2 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:41.502859 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1d28c119-f172-49b1-a76e-1d5fc7d641d2 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:41.503284 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-1d28c119-f172-49b1-a76e-1d5fc7d641d2 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:41.633682 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-1d28c119-f172-49b1-a76e-1d5fc7d641d2 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aa615f2c7c4c6eaa694f551e38436a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266789e160554ec0a0a334304a0ad39d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:41.641336 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-1d28c119-f172-49b1-a76e-1d5fc7d641d2 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 200 len: 1259 microversion: 2.1 time: 0.152267 Sep 07 16:08:41.641895 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 555/1128] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:41 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:08:41.663522 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-562c916a-a9d6-4f4e-9349-afc5e2611005 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:41.664151 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-562c916a-a9d6-4f4e-9349-afc5e2611005 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 6631be10-20b4-46ba-acd7-f78070cf384d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:41.670424 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-562c916a-a9d6-4f4e-9349-afc5e2611005 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:41.670899 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-562c916a-a9d6-4f4e-9349-afc5e2611005 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:41.671334 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-562c916a-a9d6-4f4e-9349-afc5e2611005 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:41.672042 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-562c916a-a9d6-4f4e-9349-afc5e2611005 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:41.672491 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-562c916a-a9d6-4f4e-9349-afc5e2611005 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:41.672916 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-562c916a-a9d6-4f4e-9349-afc5e2611005 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:41.804124 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-562c916a-a9d6-4f4e-9349-afc5e2611005 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:41.811767 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-562c916a-a9d6-4f4e-9349-afc5e2611005 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d" status: 200 len: 1265 microversion: 2.1 time: 0.152454 Sep 07 16:08:41.812319 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 574/1129] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:41 2022] GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:08:41.875852 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-42ebeed9-b530-4187-894f-306a30847cb4 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:41.876469 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-42ebeed9-b530-4187-894f-306a30847cb4 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 423140e3-a552-44fd-969a-7d215a453863] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:41.882451 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-42ebeed9-b530-4187-894f-306a30847cb4 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:41.882936 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-42ebeed9-b530-4187-894f-306a30847cb4 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:41.883375 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-42ebeed9-b530-4187-894f-306a30847cb4 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:41.884085 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-42ebeed9-b530-4187-894f-306a30847cb4 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:41.884547 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-42ebeed9-b530-4187-894f-306a30847cb4 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:41.884973 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-42ebeed9-b530-4187-894f-306a30847cb4 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:41.944097 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-42ebeed9-b530-4187-894f-306a30847cb4 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:41.951525 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-42ebeed9-b530-4187-894f-306a30847cb4 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863" status: 200 len: 1238 microversion: 2.1 time: 0.079636 Sep 07 16:08:41.952107 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 556/1130] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:41 2022] GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863 => generated 1238 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:08:42.663990 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-2dd656c3-857e-42b8-a7d6-31efc2ced045 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:42.664601 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-2dd656c3-857e-42b8-a7d6-31efc2ced045 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:42.671112 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2dd656c3-857e-42b8-a7d6-31efc2ced045 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:42.671684 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2dd656c3-857e-42b8-a7d6-31efc2ced045 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:42.672123 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2dd656c3-857e-42b8-a7d6-31efc2ced045 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:42.672815 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2dd656c3-857e-42b8-a7d6-31efc2ced045 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:42.673265 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2dd656c3-857e-42b8-a7d6-31efc2ced045 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:42.673698 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-2dd656c3-857e-42b8-a7d6-31efc2ced045 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:42.805245 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-2dd656c3-857e-42b8-a7d6-31efc2ced045 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aa615f2c7c4c6eaa694f551e38436a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266789e160554ec0a0a334304a0ad39d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:42.812785 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-2dd656c3-857e-42b8-a7d6-31efc2ced045 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 200 len: 1259 microversion: 2.1 time: 0.152704 Sep 07 16:08:42.813333 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 575/1131] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:42 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:08:42.834012 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f8421841-8047-4ff4-b2ab-1b8df7044780 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:42.834617 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f8421841-8047-4ff4-b2ab-1b8df7044780 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 6631be10-20b4-46ba-acd7-f78070cf384d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:42.840935 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8421841-8047-4ff4-b2ab-1b8df7044780 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:42.841411 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8421841-8047-4ff4-b2ab-1b8df7044780 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:42.841841 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8421841-8047-4ff4-b2ab-1b8df7044780 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:42.842519 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8421841-8047-4ff4-b2ab-1b8df7044780 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:42.842967 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8421841-8047-4ff4-b2ab-1b8df7044780 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:42.843384 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f8421841-8047-4ff4-b2ab-1b8df7044780 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:42.970430 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-f8421841-8047-4ff4-b2ab-1b8df7044780 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:42.974780 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c41093b8-7028-4224-bb97-c9c3fa0b46e5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:42.975385 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c41093b8-7028-4224-bb97-c9c3fa0b46e5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 423140e3-a552-44fd-969a-7d215a453863] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:42.978927 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f8421841-8047-4ff4-b2ab-1b8df7044780 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d" status: 200 len: 1265 microversion: 2.1 time: 0.148775 Sep 07 16:08:42.979485 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 557/1132] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:42 2022] GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:08:42.981213 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c41093b8-7028-4224-bb97-c9c3fa0b46e5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:42.981685 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c41093b8-7028-4224-bb97-c9c3fa0b46e5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:42.982112 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c41093b8-7028-4224-bb97-c9c3fa0b46e5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:42.982815 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c41093b8-7028-4224-bb97-c9c3fa0b46e5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:42.983256 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c41093b8-7028-4224-bb97-c9c3fa0b46e5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:42.983701 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c41093b8-7028-4224-bb97-c9c3fa0b46e5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:43.044019 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c41093b8-7028-4224-bb97-c9c3fa0b46e5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:43.051605 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c41093b8-7028-4224-bb97-c9c3fa0b46e5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863" status: 200 len: 1238 microversion: 2.1 time: 0.081356 Sep 07 16:08:43.052783 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 576/1133] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:42 2022] GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863 => generated 1238 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 16:08:43.836274 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-28e5288f-94d6-4643-8790-a49df0121bdf tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:43.837408 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-28e5288f-94d6-4643-8790-a49df0121bdf tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:43.844339 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-28e5288f-94d6-4643-8790-a49df0121bdf tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:43.844866 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-28e5288f-94d6-4643-8790-a49df0121bdf tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:43.845272 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-28e5288f-94d6-4643-8790-a49df0121bdf tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:43.845982 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-28e5288f-94d6-4643-8790-a49df0121bdf tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:43.847029 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-28e5288f-94d6-4643-8790-a49df0121bdf tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:43.847465 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-28e5288f-94d6-4643-8790-a49df0121bdf tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:44.002184 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c80f48d5-7262-49b8-8edd-34d0823d635a tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:44.002787 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c80f48d5-7262-49b8-8edd-34d0823d635a tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 6631be10-20b4-46ba-acd7-f78070cf384d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:44.009201 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c80f48d5-7262-49b8-8edd-34d0823d635a tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:44.009683 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c80f48d5-7262-49b8-8edd-34d0823d635a tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:44.010116 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c80f48d5-7262-49b8-8edd-34d0823d635a tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:44.010801 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c80f48d5-7262-49b8-8edd-34d0823d635a tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:44.011248 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c80f48d5-7262-49b8-8edd-34d0823d635a tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:44.011695 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c80f48d5-7262-49b8-8edd-34d0823d635a tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:44.050972 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-28e5288f-94d6-4643-8790-a49df0121bdf tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aa615f2c7c4c6eaa694f551e38436a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266789e160554ec0a0a334304a0ad39d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:44.058721 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-28e5288f-94d6-4643-8790-a49df0121bdf tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 200 len: 1259 microversion: 2.1 time: 0.226990 Sep 07 16:08:44.059296 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 558/1134] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:43 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 1259 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:08:44.074752 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-94eb2472-5cce-414b-9f46-94663ea37295 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:44.075384 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-94eb2472-5cce-414b-9f46-94663ea37295 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 423140e3-a552-44fd-969a-7d215a453863] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:44.081384 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-94eb2472-5cce-414b-9f46-94663ea37295 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:44.081894 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-94eb2472-5cce-414b-9f46-94663ea37295 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:44.082348 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-94eb2472-5cce-414b-9f46-94663ea37295 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:44.083601 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-94eb2472-5cce-414b-9f46-94663ea37295 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:44.084060 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-94eb2472-5cce-414b-9f46-94663ea37295 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:44.084481 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-94eb2472-5cce-414b-9f46-94663ea37295 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:44.144478 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c80f48d5-7262-49b8-8edd-34d0823d635a tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:44.146722 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-94eb2472-5cce-414b-9f46-94663ea37295 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:44.152715 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c80f48d5-7262-49b8-8edd-34d0823d635a tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d" status: 200 len: 1265 microversion: 2.1 time: 0.154395 Sep 07 16:08:44.156979 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 577/1135] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:43 2022] GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 16:08:44.157164 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-94eb2472-5cce-414b-9f46-94663ea37295 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863" status: 200 len: 1294 microversion: 2.1 time: 0.083730 Sep 07 16:08:44.157164 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 559/1136] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:44 2022] GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863 => generated 1294 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:08:45.099687 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-70cd87e7-fa29-4619-9cd6-56db8622f78e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:45.100547 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-70cd87e7-fa29-4619-9cd6-56db8622f78e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:45.118208 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70cd87e7-fa29-4619-9cd6-56db8622f78e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:45.119821 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70cd87e7-fa29-4619-9cd6-56db8622f78e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:45.120506 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70cd87e7-fa29-4619-9cd6-56db8622f78e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:45.121418 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70cd87e7-fa29-4619-9cd6-56db8622f78e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:45.122228 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70cd87e7-fa29-4619-9cd6-56db8622f78e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:45.122745 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-70cd87e7-fa29-4619-9cd6-56db8622f78e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:45.183174 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-c538670b-bd87-4531-b7c3-b646a3fb9bc2 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:45.183822 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-c538670b-bd87-4531-b7c3-b646a3fb9bc2 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 6631be10-20b4-46ba-acd7-f78070cf384d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:45.190444 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c538670b-bd87-4531-b7c3-b646a3fb9bc2 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:45.191224 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c538670b-bd87-4531-b7c3-b646a3fb9bc2 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:45.191868 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c538670b-bd87-4531-b7c3-b646a3fb9bc2 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:45.192775 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c538670b-bd87-4531-b7c3-b646a3fb9bc2 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:45.193398 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c538670b-bd87-4531-b7c3-b646a3fb9bc2 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:45.193994 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-c538670b-bd87-4531-b7c3-b646a3fb9bc2 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:45.287850 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-70cd87e7-fa29-4619-9cd6-56db8622f78e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aa615f2c7c4c6eaa694f551e38436a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266789e160554ec0a0a334304a0ad39d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:45.297855 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-70cd87e7-fa29-4619-9cd6-56db8622f78e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 200 len: 1259 microversion: 2.1 time: 0.220224 Sep 07 16:08:45.299105 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 578/1137] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:45 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 1259 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:08:45.307254 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f8d1c20d-b445-4c57-8650-f82a8b469505 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:45.308168 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f8d1c20d-b445-4c57-8650-f82a8b469505 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 423140e3-a552-44fd-969a-7d215a453863] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:45.316152 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8d1c20d-b445-4c57-8650-f82a8b469505 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:45.316818 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8d1c20d-b445-4c57-8650-f82a8b469505 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:45.317449 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8d1c20d-b445-4c57-8650-f82a8b469505 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:45.318317 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8d1c20d-b445-4c57-8650-f82a8b469505 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:45.318938 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8d1c20d-b445-4c57-8650-f82a8b469505 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:45.319520 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f8d1c20d-b445-4c57-8650-f82a8b469505 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:45.474368 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f8d1c20d-b445-4c57-8650-f82a8b469505 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:45.483652 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f8d1c20d-b445-4c57-8650-f82a8b469505 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863" status: 200 len: 1368 microversion: 2.1 time: 0.183308 Sep 07 16:08:45.484215 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 579/1138] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:45 2022] GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863 => generated 1368 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:08:45.503046 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-c538670b-bd87-4531-b7c3-b646a3fb9bc2 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:45.510943 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-c538670b-bd87-4531-b7c3-b646a3fb9bc2 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d" status: 200 len: 1265 microversion: 2.1 time: 0.331540 Sep 07 16:08:45.514793 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 560/1139] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:45 2022] GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d => generated 1265 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:08:45.954548 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-614e00ab-96bf-48c7-a2e3-06f82ad118b3 req-04a48c6e-00f3-4ecc-b057-212cb1e78c7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "423140e3-a552-44fd-969a-7d215a453863", "tag": "65a7ab29-cdc1-41e4-b419-736e34f715da"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:08:45.966459 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-614e00ab-96bf-48c7-a2e3-06f82ad118b3 req-04a48c6e-00f3-4ecc-b057-212cb1e78c7c service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:45.967089 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-614e00ab-96bf-48c7-a2e3-06f82ad118b3 req-04a48c6e-00f3-4ecc-b057-212cb1e78c7c service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:45.967993 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-614e00ab-96bf-48c7-a2e3-06f82ad118b3 req-04a48c6e-00f3-4ecc-b057-212cb1e78c7c service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:45.980376 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-614e00ab-96bf-48c7-a2e3-06f82ad118b3 req-04a48c6e-00f3-4ecc-b057-212cb1e78c7c service nova] Creating event network-changed:65a7ab29-cdc1-41e4-b419-736e34f715da for instance 423140e3-a552-44fd-969a-7d215a453863 on hv-cinder-85331 Sep 07 16:08:45.985671 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-614e00ab-96bf-48c7-a2e3-06f82ad118b3 req-04a48c6e-00f3-4ecc-b057-212cb1e78c7c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035174 Sep 07 16:08:45.986517 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 580/1140] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:08:46.324044 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-24d71332-1776-47a6-be09-1c7bbd7e1556 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:46.324848 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-24d71332-1776-47a6-be09-1c7bbd7e1556 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:46.331317 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24d71332-1776-47a6-be09-1c7bbd7e1556 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:46.332169 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24d71332-1776-47a6-be09-1c7bbd7e1556 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:46.332781 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24d71332-1776-47a6-be09-1c7bbd7e1556 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:46.333640 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24d71332-1776-47a6-be09-1c7bbd7e1556 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:46.334210 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24d71332-1776-47a6-be09-1c7bbd7e1556 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:46.334733 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-24d71332-1776-47a6-be09-1c7bbd7e1556 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:46.503521 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-24d71332-1776-47a6-be09-1c7bbd7e1556 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aa615f2c7c4c6eaa694f551e38436a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266789e160554ec0a0a334304a0ad39d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:46.509022 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-bb5ae3c2-1429-4a9b-9077-d4c69668a201 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:46.509733 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-bb5ae3c2-1429-4a9b-9077-d4c69668a201 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 423140e3-a552-44fd-969a-7d215a453863] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:46.513359 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-24d71332-1776-47a6-be09-1c7bbd7e1556 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 200 len: 1259 microversion: 2.1 time: 0.196024 Sep 07 16:08:46.514058 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 561/1141] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:46 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 1259 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:08:46.516073 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb5ae3c2-1429-4a9b-9077-d4c69668a201 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:46.516559 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb5ae3c2-1429-4a9b-9077-d4c69668a201 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:46.517001 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb5ae3c2-1429-4a9b-9077-d4c69668a201 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:46.517697 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb5ae3c2-1429-4a9b-9077-d4c69668a201 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:46.518153 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb5ae3c2-1429-4a9b-9077-d4c69668a201 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:46.518580 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-bb5ae3c2-1429-4a9b-9077-d4c69668a201 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:46.533993 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-06046467-5c56-4771-85d5-55a5b37fce44 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:46.534620 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-06046467-5c56-4771-85d5-55a5b37fce44 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 6631be10-20b4-46ba-acd7-f78070cf384d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:46.540625 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-06046467-5c56-4771-85d5-55a5b37fce44 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:46.541324 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-06046467-5c56-4771-85d5-55a5b37fce44 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:46.541760 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-06046467-5c56-4771-85d5-55a5b37fce44 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:46.542451 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-06046467-5c56-4771-85d5-55a5b37fce44 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:46.542905 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-06046467-5c56-4771-85d5-55a5b37fce44 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:46.543326 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-06046467-5c56-4771-85d5-55a5b37fce44 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:46.655698 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-bb5ae3c2-1429-4a9b-9077-d4c69668a201 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:46.659348 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:08:46.665143 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-bb5ae3c2-1429-4a9b-9077-d4c69668a201 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863" status: 200 len: 1368 microversion: 2.1 time: 0.161471 Sep 07 16:08:46.665809 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 581/1142] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:46 2022] GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 16:08:46.675521 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-06046467-5c56-4771-85d5-55a5b37fce44 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:46.684079 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-06046467-5c56-4771-85d5-55a5b37fce44 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d" status: 200 len: 1265 microversion: 2.1 time: 0.153998 Sep 07 16:08:46.684661 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 562/1143] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:46 2022] GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 16:08:47.233151 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-fa31ac5c-77c9-4708-9f12-e08485de09c4 req-543c693b-e044-46e2-9710-28ab18cdcdc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d25048e4-93d0-458e-bbe5-ba0a380f4b0c", "name": "network-vif-plugged", "status": "completed", "tag": "430afbde-c047-4cf7-8a6c-587bd546651c"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:08:47.242636 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-fa31ac5c-77c9-4708-9f12-e08485de09c4 req-543c693b-e044-46e2-9710-28ab18cdcdc4 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:47.243102 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-fa31ac5c-77c9-4708-9f12-e08485de09c4 req-543c693b-e044-46e2-9710-28ab18cdcdc4 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:47.243527 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-fa31ac5c-77c9-4708-9f12-e08485de09c4 req-543c693b-e044-46e2-9710-28ab18cdcdc4 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:47.253936 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-fa31ac5c-77c9-4708-9f12-e08485de09c4 req-543c693b-e044-46e2-9710-28ab18cdcdc4 service nova] Creating event network-vif-plugged:430afbde-c047-4cf7-8a6c-587bd546651c for instance d25048e4-93d0-458e-bbe5-ba0a380f4b0c on hv-cinder-85331 Sep 07 16:08:47.258746 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-fa31ac5c-77c9-4708-9f12-e08485de09c4 req-543c693b-e044-46e2-9710-28ab18cdcdc4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088187 Sep 07 16:08:47.259303 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 582/1144] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:08:47.535746 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bf4a03a2-ea62-4543-a10f-befb6ab13a34 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:47.536444 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bf4a03a2-ea62-4543-a10f-befb6ab13a34 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:47.542791 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bf4a03a2-ea62-4543-a10f-befb6ab13a34 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:47.543272 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bf4a03a2-ea62-4543-a10f-befb6ab13a34 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:47.543770 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bf4a03a2-ea62-4543-a10f-befb6ab13a34 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:47.544457 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bf4a03a2-ea62-4543-a10f-befb6ab13a34 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:47.544912 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bf4a03a2-ea62-4543-a10f-befb6ab13a34 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:47.545337 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bf4a03a2-ea62-4543-a10f-befb6ab13a34 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:47.549954 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=10 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:08:47.686704 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:08:47.687659 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=18 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:08:47.692964 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-44f7e076-f6c5-4546-a0fc-3281e23527bf tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:47.693751 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-44f7e076-f6c5-4546-a0fc-3281e23527bf tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 423140e3-a552-44fd-969a-7d215a453863] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:47.701089 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44f7e076-f6c5-4546-a0fc-3281e23527bf tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:47.701656 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44f7e076-f6c5-4546-a0fc-3281e23527bf tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:47.702094 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44f7e076-f6c5-4546-a0fc-3281e23527bf tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:47.702796 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44f7e076-f6c5-4546-a0fc-3281e23527bf tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:47.703241 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44f7e076-f6c5-4546-a0fc-3281e23527bf tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:47.703689 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-44f7e076-f6c5-4546-a0fc-3281e23527bf tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:47.839073 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-44f7e076-f6c5-4546-a0fc-3281e23527bf tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:47.847491 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-44f7e076-f6c5-4546-a0fc-3281e23527bf tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863" status: 200 len: 1368 microversion: 2.1 time: 0.161548 Sep 07 16:08:47.851812 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 583/1145] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:47 2022] GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 16:08:47.857100 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7bd03ed4-8033-477d-b3cf-c315a7eed581 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:47.858238 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7bd03ed4-8033-477d-b3cf-c315a7eed581 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 6631be10-20b4-46ba-acd7-f78070cf384d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:47.865724 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7bd03ed4-8033-477d-b3cf-c315a7eed581 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:47.866233 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7bd03ed4-8033-477d-b3cf-c315a7eed581 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:47.866937 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7bd03ed4-8033-477d-b3cf-c315a7eed581 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:47.867570 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7bd03ed4-8033-477d-b3cf-c315a7eed581 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:47.868099 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7bd03ed4-8033-477d-b3cf-c315a7eed581 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:47.868549 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7bd03ed4-8033-477d-b3cf-c315a7eed581 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:47.928224 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-bf4a03a2-ea62-4543-a10f-befb6ab13a34 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aa615f2c7c4c6eaa694f551e38436a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266789e160554ec0a0a334304a0ad39d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:47.935843 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bf4a03a2-ea62-4543-a10f-befb6ab13a34 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 200 len: 1259 microversion: 2.1 time: 0.403986 Sep 07 16:08:47.936406 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 563/1146] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:47 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 1259 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:08:48.000880 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-7bd03ed4-8033-477d-b3cf-c315a7eed581 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:48.009062 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7bd03ed4-8033-477d-b3cf-c315a7eed581 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d" status: 200 len: 1265 microversion: 2.1 time: 0.156220 Sep 07 16:08:48.009615 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 584/1147] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:47 2022] GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:08:48.870603 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9a763fa6-016f-4661-b163-da276b84a15d tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:48.871130 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9a763fa6-016f-4661-b163-da276b84a15d tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 423140e3-a552-44fd-969a-7d215a453863] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:48.873471 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:08:48.878748 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9a763fa6-016f-4661-b163-da276b84a15d tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:48.879231 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9a763fa6-016f-4661-b163-da276b84a15d tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:48.880205 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9a763fa6-016f-4661-b163-da276b84a15d tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:48.880891 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9a763fa6-016f-4661-b163-da276b84a15d tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:48.881343 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9a763fa6-016f-4661-b163-da276b84a15d tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:48.881765 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9a763fa6-016f-4661-b163-da276b84a15d tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:48.960309 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-54f5e05d-ba76-44b8-9b04-7dccca49c7a0 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:48.960975 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-54f5e05d-ba76-44b8-9b04-7dccca49c7a0 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:48.970721 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-54f5e05d-ba76-44b8-9b04-7dccca49c7a0 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:48.970721 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-54f5e05d-ba76-44b8-9b04-7dccca49c7a0 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:48.970721 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-54f5e05d-ba76-44b8-9b04-7dccca49c7a0 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:48.970721 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-54f5e05d-ba76-44b8-9b04-7dccca49c7a0 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:48.971185 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-54f5e05d-ba76-44b8-9b04-7dccca49c7a0 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:48.971460 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-54f5e05d-ba76-44b8-9b04-7dccca49c7a0 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:49.010391 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-9a763fa6-016f-4661-b163-da276b84a15d tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:49.013915 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=100 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:08:49.019177 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9a763fa6-016f-4661-b163-da276b84a15d tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863" status: 200 len: 1368 microversion: 2.1 time: 0.152598 Sep 07 16:08:49.019786 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 564/1148] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:48 2022] GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:08:49.030119 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0dee55fc-baa9-4504-8b8c-de9b1db10024 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:49.030727 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0dee55fc-baa9-4504-8b8c-de9b1db10024 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 6631be10-20b4-46ba-acd7-f78070cf384d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:49.036759 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0dee55fc-baa9-4504-8b8c-de9b1db10024 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:49.037244 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0dee55fc-baa9-4504-8b8c-de9b1db10024 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:49.037688 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0dee55fc-baa9-4504-8b8c-de9b1db10024 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:49.038383 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0dee55fc-baa9-4504-8b8c-de9b1db10024 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:49.038840 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0dee55fc-baa9-4504-8b8c-de9b1db10024 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:49.039444 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0dee55fc-baa9-4504-8b8c-de9b1db10024 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:49.110101 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-54f5e05d-ba76-44b8-9b04-7dccca49c7a0 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aa615f2c7c4c6eaa694f551e38436a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266789e160554ec0a0a334304a0ad39d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:49.117782 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-54f5e05d-ba76-44b8-9b04-7dccca49c7a0 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 200 len: 1259 microversion: 2.1 time: 0.162407 Sep 07 16:08:49.118348 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 585/1149] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:48 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 16:08:49.171923 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-0dee55fc-baa9-4504-8b8c-de9b1db10024 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:49.179963 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0dee55fc-baa9-4504-8b8c-de9b1db10024 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d" status: 200 len: 1265 microversion: 2.1 time: 0.153569 Sep 07 16:08:49.180515 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 565/1150] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:49 2022] GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 16:08:50.042838 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-887a5d20-6a7b-431f-98b1-ecfebae9d48b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:50.043442 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-887a5d20-6a7b-431f-98b1-ecfebae9d48b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 423140e3-a552-44fd-969a-7d215a453863] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:50.049758 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-887a5d20-6a7b-431f-98b1-ecfebae9d48b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:50.050237 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-887a5d20-6a7b-431f-98b1-ecfebae9d48b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:50.050668 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-887a5d20-6a7b-431f-98b1-ecfebae9d48b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:50.051348 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-887a5d20-6a7b-431f-98b1-ecfebae9d48b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:50.051854 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-887a5d20-6a7b-431f-98b1-ecfebae9d48b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:50.052275 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-887a5d20-6a7b-431f-98b1-ecfebae9d48b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:50.140730 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-904ff048-8365-4ecf-9099-51dbefd55bef tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:50.141346 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-904ff048-8365-4ecf-9099-51dbefd55bef tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:50.148265 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-904ff048-8365-4ecf-9099-51dbefd55bef tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:50.148747 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-904ff048-8365-4ecf-9099-51dbefd55bef tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:50.149176 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-904ff048-8365-4ecf-9099-51dbefd55bef tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:50.149866 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-904ff048-8365-4ecf-9099-51dbefd55bef tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:50.150315 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-904ff048-8365-4ecf-9099-51dbefd55bef tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:50.150734 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-904ff048-8365-4ecf-9099-51dbefd55bef tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:50.189317 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-887a5d20-6a7b-431f-98b1-ecfebae9d48b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:50.197061 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-887a5d20-6a7b-431f-98b1-ecfebae9d48b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863" status: 200 len: 1368 microversion: 2.1 time: 0.157942 Sep 07 16:08:50.197621 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 586/1151] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:50 2022] GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 16:08:50.202016 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-90b95fc0-df81-48d2-9a56-d705a5157969 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:50.202604 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-90b95fc0-df81-48d2-9a56-d705a5157969 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 6631be10-20b4-46ba-acd7-f78070cf384d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:50.208938 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90b95fc0-df81-48d2-9a56-d705a5157969 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:50.209413 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90b95fc0-df81-48d2-9a56-d705a5157969 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:50.209839 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90b95fc0-df81-48d2-9a56-d705a5157969 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:50.210516 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90b95fc0-df81-48d2-9a56-d705a5157969 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:50.210960 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90b95fc0-df81-48d2-9a56-d705a5157969 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:50.211376 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-90b95fc0-df81-48d2-9a56-d705a5157969 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:50.284811 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-904ff048-8365-4ecf-9099-51dbefd55bef tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aa615f2c7c4c6eaa694f551e38436a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266789e160554ec0a0a334304a0ad39d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:50.293701 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-904ff048-8365-4ecf-9099-51dbefd55bef tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 200 len: 1259 microversion: 2.1 time: 0.156603 Sep 07 16:08:50.294205 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 566/1152] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:50 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 16:08:50.339080 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-90b95fc0-df81-48d2-9a56-d705a5157969 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:50.346884 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-90b95fc0-df81-48d2-9a56-d705a5157969 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d" status: 200 len: 1265 microversion: 2.1 time: 0.148083 Sep 07 16:08:50.347433 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 587/1153] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:50 2022] GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:08:51.220598 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b7a72f52-d0ae-4c68-8d21-cac8a0b95889 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:51.221245 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b7a72f52-d0ae-4c68-8d21-cac8a0b95889 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 423140e3-a552-44fd-969a-7d215a453863] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:51.229269 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7a72f52-d0ae-4c68-8d21-cac8a0b95889 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:51.229756 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7a72f52-d0ae-4c68-8d21-cac8a0b95889 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:51.230194 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7a72f52-d0ae-4c68-8d21-cac8a0b95889 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:51.230887 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7a72f52-d0ae-4c68-8d21-cac8a0b95889 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:51.231345 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7a72f52-d0ae-4c68-8d21-cac8a0b95889 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:51.231798 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b7a72f52-d0ae-4c68-8d21-cac8a0b95889 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:51.316398 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-996ae3c1-5a1a-419b-a0e1-aa3d0e46aa6a tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:51.317008 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-996ae3c1-5a1a-419b-a0e1-aa3d0e46aa6a tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:51.323536 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-996ae3c1-5a1a-419b-a0e1-aa3d0e46aa6a tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:51.324042 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-996ae3c1-5a1a-419b-a0e1-aa3d0e46aa6a tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:51.324476 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-996ae3c1-5a1a-419b-a0e1-aa3d0e46aa6a tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:51.325166 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-996ae3c1-5a1a-419b-a0e1-aa3d0e46aa6a tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:51.325617 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-996ae3c1-5a1a-419b-a0e1-aa3d0e46aa6a tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:51.326038 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-996ae3c1-5a1a-419b-a0e1-aa3d0e46aa6a tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:51.362653 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-b7a72f52-d0ae-4c68-8d21-cac8a0b95889 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:51.371034 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b7a72f52-d0ae-4c68-8d21-cac8a0b95889 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863" status: 200 len: 1368 microversion: 2.1 time: 0.154260 Sep 07 16:08:51.371621 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 567/1154] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:51 2022] GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:08:51.376081 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-eb351e0c-b00c-4ec5-bb2d-55d959e646d1 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:51.376683 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-eb351e0c-b00c-4ec5-bb2d-55d959e646d1 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 6631be10-20b4-46ba-acd7-f78070cf384d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:51.382521 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb351e0c-b00c-4ec5-bb2d-55d959e646d1 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:51.383004 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb351e0c-b00c-4ec5-bb2d-55d959e646d1 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:51.383439 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb351e0c-b00c-4ec5-bb2d-55d959e646d1 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:51.384148 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb351e0c-b00c-4ec5-bb2d-55d959e646d1 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:51.384603 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb351e0c-b00c-4ec5-bb2d-55d959e646d1 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:51.385025 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-eb351e0c-b00c-4ec5-bb2d-55d959e646d1 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:51.458258 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-996ae3c1-5a1a-419b-a0e1-aa3d0e46aa6a tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aa615f2c7c4c6eaa694f551e38436a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266789e160554ec0a0a334304a0ad39d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:51.465885 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-996ae3c1-5a1a-419b-a0e1-aa3d0e46aa6a tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 200 len: 1259 microversion: 2.1 time: 0.153235 Sep 07 16:08:51.466449 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 588/1155] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:51 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 16:08:51.519774 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-eb351e0c-b00c-4ec5-bb2d-55d959e646d1 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:51.528065 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-eb351e0c-b00c-4ec5-bb2d-55d959e646d1 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d" status: 200 len: 1265 microversion: 2.1 time: 0.155508 Sep 07 16:08:51.528627 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 568/1156] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:51 2022] GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:08:52.393294 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4bad1042-803d-43de-abc7-22ba26241e4b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:52.393908 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4bad1042-803d-43de-abc7-22ba26241e4b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 423140e3-a552-44fd-969a-7d215a453863] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:52.400433 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4bad1042-803d-43de-abc7-22ba26241e4b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:52.400913 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4bad1042-803d-43de-abc7-22ba26241e4b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:52.401350 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4bad1042-803d-43de-abc7-22ba26241e4b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:52.402037 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4bad1042-803d-43de-abc7-22ba26241e4b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:52.402489 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4bad1042-803d-43de-abc7-22ba26241e4b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:52.402918 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4bad1042-803d-43de-abc7-22ba26241e4b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:52.489389 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-30ee7f97-dfa9-49bc-a739-8e69a27b2e69 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:52.490001 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-30ee7f97-dfa9-49bc-a739-8e69a27b2e69 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:52.496456 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-30ee7f97-dfa9-49bc-a739-8e69a27b2e69 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:52.496938 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-30ee7f97-dfa9-49bc-a739-8e69a27b2e69 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:52.497402 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-30ee7f97-dfa9-49bc-a739-8e69a27b2e69 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:52.498091 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-30ee7f97-dfa9-49bc-a739-8e69a27b2e69 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:52.498540 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-30ee7f97-dfa9-49bc-a739-8e69a27b2e69 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:52.498959 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-30ee7f97-dfa9-49bc-a739-8e69a27b2e69 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:52.533028 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-4bad1042-803d-43de-abc7-22ba26241e4b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:52.540681 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4bad1042-803d-43de-abc7-22ba26241e4b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863" status: 200 len: 1368 microversion: 2.1 time: 0.151191 Sep 07 16:08:52.541245 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 589/1157] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:52 2022] GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:08:52.550984 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-83a67f61-a1fb-4075-b681-0f6b98b77199 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:52.552288 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-83a67f61-a1fb-4075-b681-0f6b98b77199 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 6631be10-20b4-46ba-acd7-f78070cf384d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:52.558267 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83a67f61-a1fb-4075-b681-0f6b98b77199 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:52.558744 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83a67f61-a1fb-4075-b681-0f6b98b77199 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:52.559169 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83a67f61-a1fb-4075-b681-0f6b98b77199 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:52.559874 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83a67f61-a1fb-4075-b681-0f6b98b77199 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:52.560319 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83a67f61-a1fb-4075-b681-0f6b98b77199 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:52.560736 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-83a67f61-a1fb-4075-b681-0f6b98b77199 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:52.630924 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-30ee7f97-dfa9-49bc-a739-8e69a27b2e69 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aa615f2c7c4c6eaa694f551e38436a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266789e160554ec0a0a334304a0ad39d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:52.638698 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-30ee7f97-dfa9-49bc-a739-8e69a27b2e69 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 200 len: 1259 microversion: 2.1 time: 0.153536 Sep 07 16:08:52.639257 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 569/1158] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:52 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 16:08:52.695834 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-83a67f61-a1fb-4075-b681-0f6b98b77199 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:52.703425 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-83a67f61-a1fb-4075-b681-0f6b98b77199 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d" status: 200 len: 1265 microversion: 2.1 time: 0.156124 Sep 07 16:08:52.704006 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 590/1159] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:52 2022] GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 16:08:53.563985 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-31ac2a7e-d331-471a-a88f-5f8dbccfef60 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:53.564597 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-31ac2a7e-d331-471a-a88f-5f8dbccfef60 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 423140e3-a552-44fd-969a-7d215a453863] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:53.571551 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-31ac2a7e-d331-471a-a88f-5f8dbccfef60 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:53.572057 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-31ac2a7e-d331-471a-a88f-5f8dbccfef60 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:53.572490 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-31ac2a7e-d331-471a-a88f-5f8dbccfef60 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:53.573174 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-31ac2a7e-d331-471a-a88f-5f8dbccfef60 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:53.573626 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-31ac2a7e-d331-471a-a88f-5f8dbccfef60 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:53.574049 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-31ac2a7e-d331-471a-a88f-5f8dbccfef60 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:53.662761 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-72786c72-e8e5-4c4b-a902-51da7f9dfa8d tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:53.664412 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-72786c72-e8e5-4c4b-a902-51da7f9dfa8d tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:53.671330 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-72786c72-e8e5-4c4b-a902-51da7f9dfa8d tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:53.671920 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-72786c72-e8e5-4c4b-a902-51da7f9dfa8d tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:53.672419 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-72786c72-e8e5-4c4b-a902-51da7f9dfa8d tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:53.673195 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-72786c72-e8e5-4c4b-a902-51da7f9dfa8d tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:53.673713 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-72786c72-e8e5-4c4b-a902-51da7f9dfa8d tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:53.674198 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-72786c72-e8e5-4c4b-a902-51da7f9dfa8d tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:53.712167 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-31ac2a7e-d331-471a-a88f-5f8dbccfef60 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:53.719969 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-31ac2a7e-d331-471a-a88f-5f8dbccfef60 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863" status: 200 len: 1368 microversion: 2.1 time: 0.159755 Sep 07 16:08:53.720575 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 570/1160] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:53 2022] GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:08:53.735454 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e5430d16-405d-481d-9d98-41481efd3b35 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:53.736181 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e5430d16-405d-481d-9d98-41481efd3b35 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 6631be10-20b4-46ba-acd7-f78070cf384d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:53.742938 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e5430d16-405d-481d-9d98-41481efd3b35 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:53.743437 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e5430d16-405d-481d-9d98-41481efd3b35 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:53.743903 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e5430d16-405d-481d-9d98-41481efd3b35 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:53.744600 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e5430d16-405d-481d-9d98-41481efd3b35 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:53.745052 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e5430d16-405d-481d-9d98-41481efd3b35 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:53.745473 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e5430d16-405d-481d-9d98-41481efd3b35 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:53.819245 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-72786c72-e8e5-4c4b-a902-51da7f9dfa8d tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aa615f2c7c4c6eaa694f551e38436a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266789e160554ec0a0a334304a0ad39d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:53.827514 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-72786c72-e8e5-4c4b-a902-51da7f9dfa8d tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 200 len: 1259 microversion: 2.1 time: 0.170115 Sep 07 16:08:53.828174 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 591/1161] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:53 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 1259 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 16:08:53.881227 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-e5430d16-405d-481d-9d98-41481efd3b35 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:53.890945 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e5430d16-405d-481d-9d98-41481efd3b35 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d" status: 200 len: 1265 microversion: 2.1 time: 0.169355 Sep 07 16:08:53.891845 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 571/1162] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:53 2022] GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:08:54.743616 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cb933ab6-ef2a-4f41-bb8d-52133d694f8c tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:54.744154 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cb933ab6-ef2a-4f41-bb8d-52133d694f8c tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 423140e3-a552-44fd-969a-7d215a453863] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:54.750526 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb933ab6-ef2a-4f41-bb8d-52133d694f8c tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:54.751001 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb933ab6-ef2a-4f41-bb8d-52133d694f8c tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:54.751431 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb933ab6-ef2a-4f41-bb8d-52133d694f8c tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:54.752142 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb933ab6-ef2a-4f41-bb8d-52133d694f8c tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:54.752591 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb933ab6-ef2a-4f41-bb8d-52133d694f8c tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:54.753013 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cb933ab6-ef2a-4f41-bb8d-52133d694f8c tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:54.850723 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-78a15bb6-743e-483c-9328-3ea0be3cc0b3 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:54.851333 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-78a15bb6-743e-483c-9328-3ea0be3cc0b3 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:54.859641 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78a15bb6-743e-483c-9328-3ea0be3cc0b3 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:54.860492 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78a15bb6-743e-483c-9328-3ea0be3cc0b3 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:54.861283 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78a15bb6-743e-483c-9328-3ea0be3cc0b3 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:54.862249 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78a15bb6-743e-483c-9328-3ea0be3cc0b3 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:54.862713 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78a15bb6-743e-483c-9328-3ea0be3cc0b3 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:54.863148 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-78a15bb6-743e-483c-9328-3ea0be3cc0b3 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:54.881712 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-cb933ab6-ef2a-4f41-bb8d-52133d694f8c tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:54.889190 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cb933ab6-ef2a-4f41-bb8d-52133d694f8c tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863" status: 200 len: 1368 microversion: 2.1 time: 0.149537 Sep 07 16:08:54.889753 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 592/1163] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:54 2022] GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:08:54.914929 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d17eb0ed-59c2-4698-b038-ae9cf69e4404 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:54.915561 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d17eb0ed-59c2-4698-b038-ae9cf69e4404 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 6631be10-20b4-46ba-acd7-f78070cf384d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:54.923148 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d17eb0ed-59c2-4698-b038-ae9cf69e4404 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:54.923661 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d17eb0ed-59c2-4698-b038-ae9cf69e4404 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:54.924099 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d17eb0ed-59c2-4698-b038-ae9cf69e4404 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:54.924796 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d17eb0ed-59c2-4698-b038-ae9cf69e4404 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:54.925253 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d17eb0ed-59c2-4698-b038-ae9cf69e4404 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:54.925843 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d17eb0ed-59c2-4698-b038-ae9cf69e4404 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:55.007790 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-78a15bb6-743e-483c-9328-3ea0be3cc0b3 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aa615f2c7c4c6eaa694f551e38436a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266789e160554ec0a0a334304a0ad39d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:55.016117 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-78a15bb6-743e-483c-9328-3ea0be3cc0b3 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 200 len: 1259 microversion: 2.1 time: 0.170104 Sep 07 16:08:55.028313 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 572/1164] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:54 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 1259 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 16:08:55.090377 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d17eb0ed-59c2-4698-b038-ae9cf69e4404 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:55.101463 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d17eb0ed-59c2-4698-b038-ae9cf69e4404 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d" status: 200 len: 1265 microversion: 2.1 time: 0.190836 Sep 07 16:08:55.102134 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 593/1165] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:54 2022] GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:08:55.915674 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d37c4fb8-8d89-453f-8c57-c13265c94f6a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:55.916206 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d37c4fb8-8d89-453f-8c57-c13265c94f6a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 423140e3-a552-44fd-969a-7d215a453863] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:55.922491 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d37c4fb8-8d89-453f-8c57-c13265c94f6a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:55.922966 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d37c4fb8-8d89-453f-8c57-c13265c94f6a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:55.923396 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d37c4fb8-8d89-453f-8c57-c13265c94f6a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:55.924365 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d37c4fb8-8d89-453f-8c57-c13265c94f6a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:55.924818 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d37c4fb8-8d89-453f-8c57-c13265c94f6a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:55.925236 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d37c4fb8-8d89-453f-8c57-c13265c94f6a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:56.040501 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-a78d2ed2-c76e-410c-9ede-18f338dfe1a4 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:56.041222 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-a78d2ed2-c76e-410c-9ede-18f338dfe1a4 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:56.049613 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a78d2ed2-c76e-410c-9ede-18f338dfe1a4 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:56.050107 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a78d2ed2-c76e-410c-9ede-18f338dfe1a4 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:56.050730 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a78d2ed2-c76e-410c-9ede-18f338dfe1a4 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:56.051460 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a78d2ed2-c76e-410c-9ede-18f338dfe1a4 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:56.051963 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a78d2ed2-c76e-410c-9ede-18f338dfe1a4 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:56.052389 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-a78d2ed2-c76e-410c-9ede-18f338dfe1a4 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:56.056497 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-d37c4fb8-8d89-453f-8c57-c13265c94f6a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:56.064386 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d37c4fb8-8d89-453f-8c57-c13265c94f6a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863" status: 200 len: 1368 microversion: 2.1 time: 0.152667 Sep 07 16:08:56.065040 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 573/1166] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:55 2022] GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:08:56.127191 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9175cd51-663b-4ed6-9287-553bf5ee8088 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:56.127966 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9175cd51-663b-4ed6-9287-553bf5ee8088 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 6631be10-20b4-46ba-acd7-f78070cf384d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:56.134194 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9175cd51-663b-4ed6-9287-553bf5ee8088 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:56.134925 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9175cd51-663b-4ed6-9287-553bf5ee8088 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:56.135602 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9175cd51-663b-4ed6-9287-553bf5ee8088 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:56.136508 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9175cd51-663b-4ed6-9287-553bf5ee8088 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:56.137266 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9175cd51-663b-4ed6-9287-553bf5ee8088 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:56.137693 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9175cd51-663b-4ed6-9287-553bf5ee8088 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:56.202099 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-a78d2ed2-c76e-410c-9ede-18f338dfe1a4 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aa615f2c7c4c6eaa694f551e38436a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266789e160554ec0a0a334304a0ad39d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:56.212117 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-a78d2ed2-c76e-410c-9ede-18f338dfe1a4 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 200 len: 1259 microversion: 2.1 time: 0.175292 Sep 07 16:08:56.231990 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 594/1167] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:56 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 1259 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 16:08:56.288602 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-9175cd51-663b-4ed6-9287-553bf5ee8088 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:56.296927 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9175cd51-663b-4ed6-9287-553bf5ee8088 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d" status: 200 len: 1265 microversion: 2.1 time: 0.173364 Sep 07 16:08:56.297538 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 574/1168] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:56 2022] GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 16:08:57.086718 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-702fa510-8854-4d11-b766-699ad2a7d226 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:57.087347 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-702fa510-8854-4d11-b766-699ad2a7d226 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 423140e3-a552-44fd-969a-7d215a453863] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:57.093771 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-702fa510-8854-4d11-b766-699ad2a7d226 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:57.094251 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-702fa510-8854-4d11-b766-699ad2a7d226 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:57.094683 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-702fa510-8854-4d11-b766-699ad2a7d226 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:57.095394 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-702fa510-8854-4d11-b766-699ad2a7d226 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:57.095867 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-702fa510-8854-4d11-b766-699ad2a7d226 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:57.096292 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-702fa510-8854-4d11-b766-699ad2a7d226 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:57.226892 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-702fa510-8854-4d11-b766-699ad2a7d226 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:57.234398 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-702fa510-8854-4d11-b766-699ad2a7d226 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863" status: 200 len: 1368 microversion: 2.1 time: 0.151617 Sep 07 16:08:57.234953 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 595/1169] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:57 2022] GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:08:57.242699 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-006d13ca-c332-47ed-a4a2-cf1df27fa9e6 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:57.243391 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-006d13ca-c332-47ed-a4a2-cf1df27fa9e6 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:57.249830 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-006d13ca-c332-47ed-a4a2-cf1df27fa9e6 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:57.250417 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-006d13ca-c332-47ed-a4a2-cf1df27fa9e6 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:57.250852 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-006d13ca-c332-47ed-a4a2-cf1df27fa9e6 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:57.251586 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-006d13ca-c332-47ed-a4a2-cf1df27fa9e6 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:57.252051 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-006d13ca-c332-47ed-a4a2-cf1df27fa9e6 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:57.252472 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-006d13ca-c332-47ed-a4a2-cf1df27fa9e6 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:57.319958 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-34083029-2610-492b-b875-f22d62cca717 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:57.320681 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-34083029-2610-492b-b875-f22d62cca717 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 6631be10-20b4-46ba-acd7-f78070cf384d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:57.326620 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34083029-2610-492b-b875-f22d62cca717 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:57.327197 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34083029-2610-492b-b875-f22d62cca717 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:57.327741 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34083029-2610-492b-b875-f22d62cca717 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:57.328612 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34083029-2610-492b-b875-f22d62cca717 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:57.329137 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34083029-2610-492b-b875-f22d62cca717 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:57.329700 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-34083029-2610-492b-b875-f22d62cca717 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:57.391099 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-006d13ca-c332-47ed-a4a2-cf1df27fa9e6 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aa615f2c7c4c6eaa694f551e38436a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266789e160554ec0a0a334304a0ad39d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:57.399132 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-006d13ca-c332-47ed-a4a2-cf1df27fa9e6 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 200 len: 1259 microversion: 2.1 time: 0.160553 Sep 07 16:08:57.400158 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 575/1170] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:57 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:08:57.481646 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-34083029-2610-492b-b875-f22d62cca717 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:57.490181 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-34083029-2610-492b-b875-f22d62cca717 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d" status: 200 len: 1265 microversion: 2.1 time: 0.174010 Sep 07 16:08:57.490751 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 596/1171] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:57 2022] GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 16:08:58.258382 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-05690b09-2eee-4793-8d91-838e22aae1c3 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:58.260344 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-05690b09-2eee-4793-8d91-838e22aae1c3 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 423140e3-a552-44fd-969a-7d215a453863] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:58.266847 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-05690b09-2eee-4793-8d91-838e22aae1c3 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:58.267310 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-05690b09-2eee-4793-8d91-838e22aae1c3 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:58.267773 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-05690b09-2eee-4793-8d91-838e22aae1c3 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:58.268461 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-05690b09-2eee-4793-8d91-838e22aae1c3 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:58.268919 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-05690b09-2eee-4793-8d91-838e22aae1c3 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:58.269339 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-05690b09-2eee-4793-8d91-838e22aae1c3 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:58.355101 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-550657f4-96ad-4879-8ab7-bf6253b2c397 req-12c31fb5-7001-4504-bd36-f7263c4c5d50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "423140e3-a552-44fd-969a-7d215a453863", "name": "network-vif-plugged", "status": "completed", "tag": "65a7ab29-cdc1-41e4-b419-736e34f715da"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:08:58.367154 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-550657f4-96ad-4879-8ab7-bf6253b2c397 req-12c31fb5-7001-4504-bd36-f7263c4c5d50 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:58.367803 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-550657f4-96ad-4879-8ab7-bf6253b2c397 req-12c31fb5-7001-4504-bd36-f7263c4c5d50 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:58.368227 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-550657f4-96ad-4879-8ab7-bf6253b2c397 req-12c31fb5-7001-4504-bd36-f7263c4c5d50 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:58.382934 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-550657f4-96ad-4879-8ab7-bf6253b2c397 req-12c31fb5-7001-4504-bd36-f7263c4c5d50 service nova] Creating event network-vif-plugged:65a7ab29-cdc1-41e4-b419-736e34f715da for instance 423140e3-a552-44fd-969a-7d215a453863 on hv-cinder-85331 Sep 07 16:08:58.388634 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-550657f4-96ad-4879-8ab7-bf6253b2c397 req-12c31fb5-7001-4504-bd36-f7263c4c5d50 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037252 Sep 07 16:08:58.389547 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 597/1172] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:08:58.405016 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-05690b09-2eee-4793-8d91-838e22aae1c3 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:58.413404 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-05690b09-2eee-4793-8d91-838e22aae1c3 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863" status: 200 len: 1368 microversion: 2.1 time: 0.159405 Sep 07 16:08:58.413966 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 576/1173] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:58 2022] GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 16:08:58.425652 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fc9c010e-2a26-42a4-bc30-db5f26905cd8 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:58.426908 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fc9c010e-2a26-42a4-bc30-db5f26905cd8 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:58.436546 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc9c010e-2a26-42a4-bc30-db5f26905cd8 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:58.437042 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc9c010e-2a26-42a4-bc30-db5f26905cd8 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:58.437482 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc9c010e-2a26-42a4-bc30-db5f26905cd8 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:58.438704 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc9c010e-2a26-42a4-bc30-db5f26905cd8 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:58.438704 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc9c010e-2a26-42a4-bc30-db5f26905cd8 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:58.439053 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fc9c010e-2a26-42a4-bc30-db5f26905cd8 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:58.513632 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6a504c0d-2788-460d-b500-0b5b73cc7cb3 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:58.514778 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6a504c0d-2788-460d-b500-0b5b73cc7cb3 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 6631be10-20b4-46ba-acd7-f78070cf384d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:58.520875 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a504c0d-2788-460d-b500-0b5b73cc7cb3 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:58.521609 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a504c0d-2788-460d-b500-0b5b73cc7cb3 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:58.522264 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a504c0d-2788-460d-b500-0b5b73cc7cb3 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:58.523172 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a504c0d-2788-460d-b500-0b5b73cc7cb3 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:58.523847 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a504c0d-2788-460d-b500-0b5b73cc7cb3 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:58.524468 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6a504c0d-2788-460d-b500-0b5b73cc7cb3 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:58.603079 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-fc9c010e-2a26-42a4-bc30-db5f26905cd8 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aa615f2c7c4c6eaa694f551e38436a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266789e160554ec0a0a334304a0ad39d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:58.612651 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fc9c010e-2a26-42a4-bc30-db5f26905cd8 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 200 len: 1443 microversion: 2.1 time: 0.192326 Sep 07 16:08:58.613330 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 598/1174] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:58 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 1443 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:08:58.640909 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5b112c5d-9f97-45f6-8f4a-5f1827ff1292 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:58.641813 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5b112c5d-9f97-45f6-8f4a-5f1827ff1292 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:58.648311 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b112c5d-9f97-45f6-8f4a-5f1827ff1292 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:58.648871 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b112c5d-9f97-45f6-8f4a-5f1827ff1292 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:58.649346 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b112c5d-9f97-45f6-8f4a-5f1827ff1292 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:58.650148 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b112c5d-9f97-45f6-8f4a-5f1827ff1292 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:58.650607 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b112c5d-9f97-45f6-8f4a-5f1827ff1292 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:58.651608 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b112c5d-9f97-45f6-8f4a-5f1827ff1292 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:58.740924 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-6a504c0d-2788-460d-b500-0b5b73cc7cb3 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:58.749321 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6a504c0d-2788-460d-b500-0b5b73cc7cb3 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d" status: 200 len: 1265 microversion: 2.1 time: 0.239692 Sep 07 16:08:58.750344 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 577/1175] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:58 2022] GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d => generated 1265 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:08:58.796741 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5b112c5d-9f97-45f6-8f4a-5f1827ff1292 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aa615f2c7c4c6eaa694f551e38436a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266789e160554ec0a0a334304a0ad39d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:58.800386 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=100 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:08:58.806399 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5b112c5d-9f97-45f6-8f4a-5f1827ff1292 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 200 len: 1443 microversion: 2.1 time: 0.172190 Sep 07 16:08:58.806960 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 599/1176] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:58 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 1443 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 16:08:59.438287 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a2e1a63a-914a-4245-8f2b-d1951d14abb5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:59.439015 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a2e1a63a-914a-4245-8f2b-d1951d14abb5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 423140e3-a552-44fd-969a-7d215a453863] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:59.446772 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a2e1a63a-914a-4245-8f2b-d1951d14abb5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:59.447351 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a2e1a63a-914a-4245-8f2b-d1951d14abb5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:59.447889 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a2e1a63a-914a-4245-8f2b-d1951d14abb5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:59.449103 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a2e1a63a-914a-4245-8f2b-d1951d14abb5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:59.449633 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a2e1a63a-914a-4245-8f2b-d1951d14abb5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:59.450597 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a2e1a63a-914a-4245-8f2b-d1951d14abb5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:59.621771 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-a2e1a63a-914a-4245-8f2b-d1951d14abb5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:08:59.630756 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a2e1a63a-914a-4245-8f2b-d1951d14abb5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863" status: 200 len: 1368 microversion: 2.1 time: 0.196688 Sep 07 16:08:59.631317 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 578/1177] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:59 2022] GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863 => generated 1368 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:08:59.771683 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e108ad3f-b367-44dd-89ef-3f07ad0257aa tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:08:59.772913 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e108ad3f-b367-44dd-89ef-3f07ad0257aa tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 6631be10-20b4-46ba-acd7-f78070cf384d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:08:59.780708 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e108ad3f-b367-44dd-89ef-3f07ad0257aa tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:59.781353 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e108ad3f-b367-44dd-89ef-3f07ad0257aa tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:59.782084 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e108ad3f-b367-44dd-89ef-3f07ad0257aa tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:08:59.783079 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e108ad3f-b367-44dd-89ef-3f07ad0257aa tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:08:59.783531 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e108ad3f-b367-44dd-89ef-3f07ad0257aa tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:08:59.784130 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e108ad3f-b367-44dd-89ef-3f07ad0257aa tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:09:00.001341 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e108ad3f-b367-44dd-89ef-3f07ad0257aa tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:09:00.010093 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e108ad3f-b367-44dd-89ef-3f07ad0257aa tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d" status: 200 len: 1265 microversion: 2.1 time: 0.242262 Sep 07 16:09:00.022036 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 600/1178] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:08:59 2022] GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d => generated 1265 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:09:00.406664 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-5aad348c-38a2-4961-bfeb-9bad0f99be94 req-fbccc64d-1d46-4e21-bcae-2ae688169bb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6631be10-20b4-46ba-acd7-f78070cf384d", "name": "network-vif-plugged", "status": "completed", "tag": "967b7d4c-12d8-4ab7-bdab-2c385d5d8e50"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:09:00.419176 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-5aad348c-38a2-4961-bfeb-9bad0f99be94 req-fbccc64d-1d46-4e21-bcae-2ae688169bb8 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:09:00.419892 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-5aad348c-38a2-4961-bfeb-9bad0f99be94 req-fbccc64d-1d46-4e21-bcae-2ae688169bb8 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:09:00.420407 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-5aad348c-38a2-4961-bfeb-9bad0f99be94 req-fbccc64d-1d46-4e21-bcae-2ae688169bb8 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:09:00.434116 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-5aad348c-38a2-4961-bfeb-9bad0f99be94 req-fbccc64d-1d46-4e21-bcae-2ae688169bb8 service nova] Creating event network-vif-plugged:967b7d4c-12d8-4ab7-bdab-2c385d5d8e50 for instance 6631be10-20b4-46ba-acd7-f78070cf384d on hv-cinder-85331 Sep 07 16:09:00.441230 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-5aad348c-38a2-4961-bfeb-9bad0f99be94 req-fbccc64d-1d46-4e21-bcae-2ae688169bb8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040226 Sep 07 16:09:00.442604 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 579/1179] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:09:00.653976 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-dfcd0e9e-a78f-4151-8be2-e0067794e44a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:09:00.654611 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-dfcd0e9e-a78f-4151-8be2-e0067794e44a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 423140e3-a552-44fd-969a-7d215a453863] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:09:00.661357 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dfcd0e9e-a78f-4151-8be2-e0067794e44a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:09:00.661835 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dfcd0e9e-a78f-4151-8be2-e0067794e44a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:09:00.662265 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dfcd0e9e-a78f-4151-8be2-e0067794e44a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:09:00.662947 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dfcd0e9e-a78f-4151-8be2-e0067794e44a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:09:00.663390 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dfcd0e9e-a78f-4151-8be2-e0067794e44a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:09:00.663833 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-dfcd0e9e-a78f-4151-8be2-e0067794e44a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:09:00.827714 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-6a8a0be9-a859-4721-91d3-098429f944ea req-1cefe7d2-3978-4a61-af7b-3c963223f8df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d25048e4-93d0-458e-bbe5-ba0a380f4b0c", "tag": "430afbde-c047-4cf7-8a6c-587bd546651c"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:09:00.840381 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-6a8a0be9-a859-4721-91d3-098429f944ea req-1cefe7d2-3978-4a61-af7b-3c963223f8df service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:09:00.841128 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-6a8a0be9-a859-4721-91d3-098429f944ea req-1cefe7d2-3978-4a61-af7b-3c963223f8df service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:09:00.841729 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-6a8a0be9-a859-4721-91d3-098429f944ea req-1cefe7d2-3978-4a61-af7b-3c963223f8df service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:09:00.850194 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-dfcd0e9e-a78f-4151-8be2-e0067794e44a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:09:00.858746 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-dfcd0e9e-a78f-4151-8be2-e0067794e44a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863" status: 200 len: 1368 microversion: 2.1 time: 0.208507 Sep 07 16:09:00.860088 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 601/1180] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:09:00 2022] GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863 => generated 1368 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:09:00.875388 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-6a8a0be9-a859-4721-91d3-098429f944ea req-1cefe7d2-3978-4a61-af7b-3c963223f8df service nova] Creating event network-changed:430afbde-c047-4cf7-8a6c-587bd546651c for instance d25048e4-93d0-458e-bbe5-ba0a380f4b0c on hv-cinder-85331 Sep 07 16:09:00.881399 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-6a8a0be9-a859-4721-91d3-098429f944ea req-1cefe7d2-3978-4a61-af7b-3c963223f8df service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059796 Sep 07 16:09:00.882409 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 580/1181] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:09:01.048318 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-fcc2a0ce-df08-4342-9bc7-9f72fe0147f0 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:09:01.049340 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-fcc2a0ce-df08-4342-9bc7-9f72fe0147f0 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 6631be10-20b4-46ba-acd7-f78070cf384d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:09:01.062322 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fcc2a0ce-df08-4342-9bc7-9f72fe0147f0 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:09:01.062983 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fcc2a0ce-df08-4342-9bc7-9f72fe0147f0 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:09:01.063515 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fcc2a0ce-df08-4342-9bc7-9f72fe0147f0 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:09:01.072229 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fcc2a0ce-df08-4342-9bc7-9f72fe0147f0 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:09:01.072784 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fcc2a0ce-df08-4342-9bc7-9f72fe0147f0 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:09:01.073224 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-fcc2a0ce-df08-4342-9bc7-9f72fe0147f0 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:09:01.289170 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-fcc2a0ce-df08-4342-9bc7-9f72fe0147f0 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:09:01.297688 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-fcc2a0ce-df08-4342-9bc7-9f72fe0147f0 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d" status: 200 len: 1265 microversion: 2.1 time: 0.262636 Sep 07 16:09:01.298264 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 602/1182] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:09:01 2022] GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d => generated 1265 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:09:01.882779 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9228c290-31f2-407f-a8ac-9bc132ecb4c6 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:09:01.883478 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9228c290-31f2-407f-a8ac-9bc132ecb4c6 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 423140e3-a552-44fd-969a-7d215a453863] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:09:01.890490 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9228c290-31f2-407f-a8ac-9bc132ecb4c6 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:09:01.890983 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9228c290-31f2-407f-a8ac-9bc132ecb4c6 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:09:01.891435 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9228c290-31f2-407f-a8ac-9bc132ecb4c6 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:09:01.892157 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9228c290-31f2-407f-a8ac-9bc132ecb4c6 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:09:01.892612 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9228c290-31f2-407f-a8ac-9bc132ecb4c6 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:09:01.893033 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9228c290-31f2-407f-a8ac-9bc132ecb4c6 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:09:02.025969 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-9228c290-31f2-407f-a8ac-9bc132ecb4c6 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:09:02.033602 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9228c290-31f2-407f-a8ac-9bc132ecb4c6 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863" status: 200 len: 1559 microversion: 2.1 time: 0.155510 Sep 07 16:09:02.034166 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 581/1183] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:09:01 2022] GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:09:02.055914 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4a59b852-72e1-4d3b-876f-3dc18db579e9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:09:02.056394 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4a59b852-72e1-4d3b-876f-3dc18db579e9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 423140e3-a552-44fd-969a-7d215a453863] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:09:02.062749 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a59b852-72e1-4d3b-876f-3dc18db579e9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:09:02.063219 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a59b852-72e1-4d3b-876f-3dc18db579e9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:09:02.063682 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a59b852-72e1-4d3b-876f-3dc18db579e9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:09:02.064361 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a59b852-72e1-4d3b-876f-3dc18db579e9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:09:02.064804 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a59b852-72e1-4d3b-876f-3dc18db579e9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:09:02.065220 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4a59b852-72e1-4d3b-876f-3dc18db579e9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:09:02.139887 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4a59b852-72e1-4d3b-876f-3dc18db579e9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087620 Sep 07 16:09:02.140472 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 603/1184] 10.222.0.17 () {58 vars in 1275 bytes} [Wed Sep 7 16:09:02 2022] GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:09:02.320791 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-719041bd-df58-4200-93f9-4c962daf7b6c tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:09:02.321421 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-719041bd-df58-4200-93f9-4c962daf7b6c tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 6631be10-20b4-46ba-acd7-f78070cf384d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:09:02.327828 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-719041bd-df58-4200-93f9-4c962daf7b6c tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:09:02.328356 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-719041bd-df58-4200-93f9-4c962daf7b6c tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:09:02.328743 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-719041bd-df58-4200-93f9-4c962daf7b6c tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:09:02.329648 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-719041bd-df58-4200-93f9-4c962daf7b6c tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:09:02.330099 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-719041bd-df58-4200-93f9-4c962daf7b6c tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:09:02.330537 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-719041bd-df58-4200-93f9-4c962daf7b6c tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:09:02.529811 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-719041bd-df58-4200-93f9-4c962daf7b6c tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:09:02.534158 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=100 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:09:02.539908 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-719041bd-df58-4200-93f9-4c962daf7b6c tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d" status: 200 len: 1265 microversion: 2.1 time: 0.223045 Sep 07 16:09:02.540480 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 582/1185] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:09:02 2022] GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d => generated 1265 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:09:03.335337 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-9f7bce75-c13f-4bf4-b6eb-0d42140a8d52 req-30ebdc45-2a89-4743-b23c-cac1693cd7ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "423140e3-a552-44fd-969a-7d215a453863", "tag": "65a7ab29-cdc1-41e4-b419-736e34f715da"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:09:03.345242 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9f7bce75-c13f-4bf4-b6eb-0d42140a8d52 req-30ebdc45-2a89-4743-b23c-cac1693cd7ef service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:09:03.345710 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9f7bce75-c13f-4bf4-b6eb-0d42140a8d52 req-30ebdc45-2a89-4743-b23c-cac1693cd7ef service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:09:03.346148 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-9f7bce75-c13f-4bf4-b6eb-0d42140a8d52 req-30ebdc45-2a89-4743-b23c-cac1693cd7ef service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:09:03.358038 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-9f7bce75-c13f-4bf4-b6eb-0d42140a8d52 req-30ebdc45-2a89-4743-b23c-cac1693cd7ef service nova] Creating event network-changed:65a7ab29-cdc1-41e4-b419-736e34f715da for instance 423140e3-a552-44fd-969a-7d215a453863 on hv-cinder-85331 Sep 07 16:09:03.363317 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-9f7bce75-c13f-4bf4-b6eb-0d42140a8d52 req-30ebdc45-2a89-4743-b23c-cac1693cd7ef service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033284 Sep 07 16:09:03.364117 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 604/1186] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:09:03.565390 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-fd87e90f-e676-4b19-b39c-69bdc05d111a tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:09:03.566224 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-fd87e90f-e676-4b19-b39c-69bdc05d111a tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 6631be10-20b4-46ba-acd7-f78070cf384d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:09:03.573803 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd87e90f-e676-4b19-b39c-69bdc05d111a tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:09:03.574379 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd87e90f-e676-4b19-b39c-69bdc05d111a tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:09:03.574912 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd87e90f-e676-4b19-b39c-69bdc05d111a tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:09:03.575900 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd87e90f-e676-4b19-b39c-69bdc05d111a tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:09:03.576363 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd87e90f-e676-4b19-b39c-69bdc05d111a tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:09:03.576793 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-fd87e90f-e676-4b19-b39c-69bdc05d111a tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:09:03.801734 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-fd87e90f-e676-4b19-b39c-69bdc05d111a tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:09:03.810029 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-fd87e90f-e676-4b19-b39c-69bdc05d111a tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d" status: 200 len: 1451 microversion: 2.1 time: 0.249276 Sep 07 16:09:03.820729 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 583/1187] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:09:03 2022] GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d => generated 1451 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:09:03.833815 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8485c4b4-1359-48f1-bdad-14656e551884 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:09:03.834549 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8485c4b4-1359-48f1-bdad-14656e551884 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 6631be10-20b4-46ba-acd7-f78070cf384d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:09:03.842030 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8485c4b4-1359-48f1-bdad-14656e551884 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:09:03.842513 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8485c4b4-1359-48f1-bdad-14656e551884 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:09:03.842953 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8485c4b4-1359-48f1-bdad-14656e551884 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:09:03.844258 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8485c4b4-1359-48f1-bdad-14656e551884 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:09:03.844710 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8485c4b4-1359-48f1-bdad-14656e551884 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:09:03.845133 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8485c4b4-1359-48f1-bdad-14656e551884 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:09:04.008052 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-8485c4b4-1359-48f1-bdad-14656e551884 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:09:04.017978 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8485c4b4-1359-48f1-bdad-14656e551884 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d" status: 200 len: 1451 microversion: 2.1 time: 0.188382 Sep 07 16:09:04.019235 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 605/1188] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:09:03 2022] GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d => generated 1451 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:09:05.823980 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-e9d4eb51-1302-409a-98aa-82c7e82635e6 req-19a00dc5-a2d5-4bca-9ac2-287a9fdbbd97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6631be10-20b4-46ba-acd7-f78070cf384d", "tag": "967b7d4c-12d8-4ab7-bdab-2c385d5d8e50"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:09:05.838674 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e9d4eb51-1302-409a-98aa-82c7e82635e6 req-19a00dc5-a2d5-4bca-9ac2-287a9fdbbd97 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:09:05.839343 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e9d4eb51-1302-409a-98aa-82c7e82635e6 req-19a00dc5-a2d5-4bca-9ac2-287a9fdbbd97 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:09:05.839836 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-e9d4eb51-1302-409a-98aa-82c7e82635e6 req-19a00dc5-a2d5-4bca-9ac2-287a9fdbbd97 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:09:05.852782 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-e9d4eb51-1302-409a-98aa-82c7e82635e6 req-19a00dc5-a2d5-4bca-9ac2-287a9fdbbd97 service nova] Creating event network-changed:967b7d4c-12d8-4ab7-bdab-2c385d5d8e50 for instance 6631be10-20b4-46ba-acd7-f78070cf384d on hv-cinder-85331 Sep 07 16:09:05.857792 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-e9d4eb51-1302-409a-98aa-82c7e82635e6 req-19a00dc5-a2d5-4bca-9ac2-287a9fdbbd97 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037349 Sep 07 16:09:05.858388 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 584/1189] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:10:33.089173 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:33.089915 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=30 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:33.255088 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-afb10d0c-49ab-434b-a914-4a98caf26208 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:10:33.255631 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-afb10d0c-49ab-434b-a914-4a98caf26208 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 423140e3-a552-44fd-969a-7d215a453863] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:10:33.261418 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-afb10d0c-49ab-434b-a914-4a98caf26208 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:10:33.261891 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-afb10d0c-49ab-434b-a914-4a98caf26208 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:10:33.262322 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-afb10d0c-49ab-434b-a914-4a98caf26208 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:10:33.262995 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-afb10d0c-49ab-434b-a914-4a98caf26208 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:10:33.263439 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-afb10d0c-49ab-434b-a914-4a98caf26208 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:10:33.263879 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-afb10d0c-49ab-434b-a914-4a98caf26208 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:10:33.289875 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-afb10d0c-49ab-434b-a914-4a98caf26208 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863/ips" status: 200 len: 151 microversion: 2.1 time: 0.202396 Sep 07 16:10:33.290417 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 606/1190] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Sep 7 16:10:33 2022] GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863/ips => generated 151 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:10:35.680123 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=41 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:35.680847 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=8 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:35.682138 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 07 16:10:35.682268 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Wed Sep 7 16:10:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863/os-volume_attachments (ip 10.222.0.17) !!! Sep 07 16:10:35.693032 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5b10f294-b442-4380-9d13-70c4d8eab878 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "69fc8e69-0783-44d6-afb6-01d679ccf25c"}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:10:35.695419 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5b10f294-b442-4380-9d13-70c4d8eab878 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 423140e3-a552-44fd-969a-7d215a453863] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:10:35.704126 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5b10f294-b442-4380-9d13-70c4d8eab878 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:10:35.704606 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5b10f294-b442-4380-9d13-70c4d8eab878 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:10:35.705038 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5b10f294-b442-4380-9d13-70c4d8eab878 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:10:35.705726 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5b10f294-b442-4380-9d13-70c4d8eab878 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:10:35.706180 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5b10f294-b442-4380-9d13-70c4d8eab878 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:10:35.706604 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5b10f294-b442-4380-9d13-70c4d8eab878 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:10:35.978902 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5b10f294-b442-4380-9d13-70c4d8eab878 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "POST /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.300883 Sep 07 16:10:35.979535 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 585/1191] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Sep 7 16:10:35 2022] POST /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863/os-volume_attachments => generated 194 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:10:43.510859 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7e788db3-340c-48d0-8e33-e0e15e0d2f10] AMQP server on 10.222.0.17:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 07 16:10:43.514452 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-93c46e9f-01a1-46ec-86fb-52a5dedfa610 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "69fc8e69-0783-44d6-afb6-01d679ccf25c"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:10:43.516877 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-93c46e9f-01a1-46ec-86fb-52a5dedfa610 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 423140e3-a552-44fd-969a-7d215a453863] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:10:43.518842 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:43.519982 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=4 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:10:43.525602 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93c46e9f-01a1-46ec-86fb-52a5dedfa610 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:10:43.526058 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93c46e9f-01a1-46ec-86fb-52a5dedfa610 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:10:43.526488 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93c46e9f-01a1-46ec-86fb-52a5dedfa610 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:10:43.527160 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93c46e9f-01a1-46ec-86fb-52a5dedfa610 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:10:43.527627 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93c46e9f-01a1-46ec-86fb-52a5dedfa610 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:10:43.528047 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-93c46e9f-01a1-46ec-86fb-52a5dedfa610 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:10:43.605884 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-93c46e9f-01a1-46ec-86fb-52a5dedfa610 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] HTTP exception thrown: Invalid volume: volume 69fc8e69-0783-44d6-afb6-01d679ccf25c is already attached to instances: 423140e3-a552-44fd-969a-7d215a453863 Sep 07 16:10:43.607637 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-93c46e9f-01a1-46ec-86fb-52a5dedfa610 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Request method failure captured: Sep 07 16:10:43.607637 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: request: POST /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863/os-volume_attachments HTTP/1.1 Sep 07 16:10:43.607637 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept: application/json Sep 07 16:10:43.607637 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Sep 07 16:10:43.607637 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Connection: close Sep 07 16:10:43.607637 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Length: 74 Sep 07 16:10:43.607637 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Type: application/json Sep 07 16:10:43.607637 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Host: 10.222.0.17 Sep 07 16:10:43.607637 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Sep 07 16:10:43.607637 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Sep 07 16:10:43.607637 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjGMEEfdw4OUg2B39RKswOmT5z54ISjPs9Ys-pBh0gUFq_XPVQCzkiphko1MTfezgc9xGOiE9M4-fp-aoq8efmnODenpErT0vQYyVQWrBzaRRoo-wl5i6l7H-bvKljvP6w5U1cAwX2okeVPnYRC9X59Bw9YuV07_v6iRyvOmKt9QO33DU Sep 07 16:10:43.607637 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Sep 07 16:10:43.607637 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Sep 07 16:10:43.607637 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Sep 07 16:10:43.607637 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Sep 07 16:10:43.607637 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Sep 07 16:10:43.607637 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Sep 07 16:10:43.607637 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Id: ab1963a1a6684af58f5c240787788b60 Sep 07 16:10:43.607637 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-AttachVolumeNegativeTest-857872657 Sep 07 16:10:43.607637 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Role: reader,member Sep 07 16:10:43.607637 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Roles: reader,member Sep 07 16:10:43.609369 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ab1963a1a6684af58f5c240787788b60", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ab1963a1a6684af58f5c240787788b60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ab1963a1a6684af58f5c240787788b60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ab1963a1a6684af58f5c240787788b60"}]}] Sep 07 16:10:43.609369 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-AttachVolumeNegativeTest-857872657 Sep 07 16:10:43.609369 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Id: ab1963a1a6684af58f5c240787788b60 Sep 07 16:10:43.609369 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-857872657 Sep 07 16:10:43.609369 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User: tempest-AttachVolumeNegativeTest-857872657-project Sep 07 16:10:43.609369 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Sep 07 16:10:43.609369 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Sep 07 16:10:43.609369 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Id: 2dab44e593194fe788216b029eecd10c Sep 07 16:10:43.609369 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-AttachVolumeNegativeTest-857872657-project Sep 07 16:10:43.609369 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Sep 07 16:10:43.609369 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: {"volumeAttachment": {"volumeId": "69fc8e69-0783-44d6-afb6-01d679ccf25c"}} Sep 07 16:10:43.609369 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: method: > Sep 07 16:10:43.610290 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: exception: Invalid volume: volume 69fc8e69-0783-44d6-afb6-01d679ccf25c is already attached to instances: 423140e3-a552-44fd-969a-7d215a453863 Sep 07 16:10:43.610290 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: action_args: {'server_id': '423140e3-a552-44fd-969a-7d215a453863', 'body': {'volumeAttachment': {'volumeId': '69fc8e69-0783-44d6-afb6-01d679ccf25c'}}} Sep 07 16:10:43.610290 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 16:10:43.610290 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:10:43.610290 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 07 16:10:43.610290 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 07 16:10:43.610290 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 16:10:43.610290 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 16:10:43.610290 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 07 16:10:43.610290 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 07 16:10:43.610290 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 07 16:10:43.610290 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 07 16:10:43.610290 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 07 16:10:43.610290 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 07 16:10:43.610290 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 69fc8e69-0783-44d6-afb6-01d679ccf25c is already attached to instances: 423140e3-a552-44fd-969a-7d215a453863 Sep 07 16:10:43.610290 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:10:43.610290 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:10:43.610290 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:10:43.610290 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:10:43.611670 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:10:43.611670 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:10:43.611670 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 16:10:43.611670 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 16:10:43.611670 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 16:10:43.611670 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 16:10:43.611670 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 16:10:43.611670 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 16:10:43.611670 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 16:10:43.611670 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 16:10:43.611670 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 16:10:43.611670 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 16:10:43.611670 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 07 16:10:43.611670 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 07 16:10:43.611670 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 69fc8e69-0783-44d6-afb6-01d679ccf25c is already attached to instances: 423140e3-a552-44fd-969a-7d215a453863 Sep 07 16:10:43.611670 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:10:43.611670 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:10:43.611670 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:10:43.611670 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:10:43.611670 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:10:43.613758 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:10:43.613758 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 16:10:43.613758 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 16:10:43.613758 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 69fc8e69-0783-44d6-afb6-01d679ccf25c is already attached to instances: 423140e3-a552-44fd-969a-7d215a453863 Sep 07 16:10:43.613758 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:10:43.613758 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-93c46e9f-01a1-46ec-86fb-52a5dedfa610 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Returning 400 to user: Invalid volume: volume 69fc8e69-0783-44d6-afb6-01d679ccf25c is already attached to instances: 423140e3-a552-44fd-969a-7d215a453863 {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 16:10:43.613758 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-93c46e9f-01a1-46ec-86fb-52a5dedfa610 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "POST /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099508 Sep 07 16:10:43.613758 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 607/1192] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Sep 7 16:10:43 2022] POST /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 16:10:43.674196 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-91ed6293-1924-4f22-b060-69f508590950 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:10:43.674786 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-91ed6293-1924-4f22-b060-69f508590950 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 423140e3-a552-44fd-969a-7d215a453863] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:10:43.681473 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-91ed6293-1924-4f22-b060-69f508590950 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:10:43.681956 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-91ed6293-1924-4f22-b060-69f508590950 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:10:43.682396 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-91ed6293-1924-4f22-b060-69f508590950 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:10:43.683093 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-91ed6293-1924-4f22-b060-69f508590950 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:10:43.683568 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-91ed6293-1924-4f22-b060-69f508590950 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:10:43.684002 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-91ed6293-1924-4f22-b060-69f508590950 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:10:43.763121 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-91ed6293-1924-4f22-b060-69f508590950 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lazy-loading 'services' on Instance uuid 423140e3-a552-44fd-969a-7d215a453863 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 16:10:43.835390 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-91ed6293-1924-4f22-b060-69f508590950 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "DELETE /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863/os-volume_attachments/69fc8e69-0783-44d6-afb6-01d679ccf25c" status: 202 len: 0 microversion: 2.1 time: 0.165303 Sep 07 16:10:43.836000 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 586/1193] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Sep 7 16:10:43 2022] DELETE /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863/os-volume_attachments/69fc8e69-0783-44d6-afb6-01d679ccf25c => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 16:10:43.844489 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-35fa5a37-bb70-4c40-8c47-86d41f7858d5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:10:43.846856 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-35fa5a37-bb70-4c40-8c47-86d41f7858d5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 423140e3-a552-44fd-969a-7d215a453863] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:10:43.853809 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35fa5a37-bb70-4c40-8c47-86d41f7858d5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:10:43.854283 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35fa5a37-bb70-4c40-8c47-86d41f7858d5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:10:43.854715 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35fa5a37-bb70-4c40-8c47-86d41f7858d5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:10:43.855439 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35fa5a37-bb70-4c40-8c47-86d41f7858d5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:10:43.855922 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35fa5a37-bb70-4c40-8c47-86d41f7858d5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:10:43.856376 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-35fa5a37-bb70-4c40-8c47-86d41f7858d5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:10:43.885879 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-35fa5a37-bb70-4c40-8c47-86d41f7858d5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045341 Sep 07 16:10:43.886432 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 608/1194] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Sep 7 16:10:43 2022] GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:10:44.899190 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d1042fff-ffba-42df-b816-4c85301e21ba tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:10:44.901542 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d1042fff-ffba-42df-b816-4c85301e21ba tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 423140e3-a552-44fd-969a-7d215a453863] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:10:44.907689 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1042fff-ffba-42df-b816-4c85301e21ba tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:10:44.908169 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1042fff-ffba-42df-b816-4c85301e21ba tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:10:44.908607 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1042fff-ffba-42df-b816-4c85301e21ba tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:10:44.909285 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1042fff-ffba-42df-b816-4c85301e21ba tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:10:44.909738 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1042fff-ffba-42df-b816-4c85301e21ba tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:10:44.910164 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d1042fff-ffba-42df-b816-4c85301e21ba tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:10:44.938414 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d1042fff-ffba-42df-b816-4c85301e21ba tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044024 Sep 07 16:10:44.938949 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 587/1195] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Sep 7 16:10:44 2022] GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 16:10:45.001525 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5ad7c69a-c6c3-42bf-8dbc-6daf31c6ca6a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:10:45.002011 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5ad7c69a-c6c3-42bf-8dbc-6daf31c6ca6a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 423140e3-a552-44fd-969a-7d215a453863] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:10:45.009878 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5ad7c69a-c6c3-42bf-8dbc-6daf31c6ca6a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:10:45.010353 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5ad7c69a-c6c3-42bf-8dbc-6daf31c6ca6a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:10:45.010784 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5ad7c69a-c6c3-42bf-8dbc-6daf31c6ca6a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:10:45.011467 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5ad7c69a-c6c3-42bf-8dbc-6daf31c6ca6a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:10:45.011938 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5ad7c69a-c6c3-42bf-8dbc-6daf31c6ca6a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:10:45.012356 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5ad7c69a-c6c3-42bf-8dbc-6daf31c6ca6a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:10:45.018231 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] [7e788db3-340c-48d0-8e33-e0e15e0d2f10] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 58434. Sep 07 16:10:45.042782 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5ad7c69a-c6c3-42bf-8dbc-6daf31c6ca6a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 423140e3-a552-44fd-969a-7d215a453863] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 16:10:45.114890 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5ad7c69a-c6c3-42bf-8dbc-6daf31c6ca6a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "DELETE /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863" status: 204 len: 0 microversion: 2.1 time: 0.116852 Sep 07 16:10:45.115600 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 609/1196] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Sep 7 16:10:44 2022] DELETE /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 16:10:45.124165 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2ac13374-3077-4646-83a1-1fb075917798 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:10:45.125055 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2ac13374-3077-4646-83a1-1fb075917798 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 423140e3-a552-44fd-969a-7d215a453863] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:10:45.131280 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2ac13374-3077-4646-83a1-1fb075917798 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:10:45.131816 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2ac13374-3077-4646-83a1-1fb075917798 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:10:45.132455 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2ac13374-3077-4646-83a1-1fb075917798 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:10:45.133177 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2ac13374-3077-4646-83a1-1fb075917798 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:10:45.133628 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2ac13374-3077-4646-83a1-1fb075917798 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:10:45.134052 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2ac13374-3077-4646-83a1-1fb075917798 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:10:45.264656 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-2ac13374-3077-4646-83a1-1fb075917798 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:10:45.272347 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2ac13374-3077-4646-83a1-1fb075917798 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863" status: 200 len: 1684 microversion: 2.1 time: 0.152589 Sep 07 16:10:45.272917 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 588/1197] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:10:45 2022] GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:10:46.296482 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-1d9257f6-6ede-4246-9790-139c09e6561f tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:10:46.297188 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-1d9257f6-6ede-4246-9790-139c09e6561f tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 423140e3-a552-44fd-969a-7d215a453863] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:10:46.304098 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d9257f6-6ede-4246-9790-139c09e6561f tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:10:46.304586 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d9257f6-6ede-4246-9790-139c09e6561f tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:10:46.305023 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d9257f6-6ede-4246-9790-139c09e6561f tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:10:46.305707 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d9257f6-6ede-4246-9790-139c09e6561f tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:10:46.306161 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d9257f6-6ede-4246-9790-139c09e6561f tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:10:46.306586 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-1d9257f6-6ede-4246-9790-139c09e6561f tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:10:46.439291 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-1d9257f6-6ede-4246-9790-139c09e6561f tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:10:46.447649 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-1d9257f6-6ede-4246-9790-139c09e6561f tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863" status: 200 len: 1684 microversion: 2.1 time: 0.155349 Sep 07 16:10:46.448207 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 610/1198] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:10:46 2022] GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:10:47.470196 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d3384c5d-0337-402b-be5a-7c4b862854a0 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:10:47.471079 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d3384c5d-0337-402b-be5a-7c4b862854a0 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 423140e3-a552-44fd-969a-7d215a453863] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:10:47.477833 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d3384c5d-0337-402b-be5a-7c4b862854a0 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:10:47.478314 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d3384c5d-0337-402b-be5a-7c4b862854a0 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:10:47.478748 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d3384c5d-0337-402b-be5a-7c4b862854a0 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:10:47.479438 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d3384c5d-0337-402b-be5a-7c4b862854a0 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:10:47.479927 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d3384c5d-0337-402b-be5a-7c4b862854a0 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:10:47.480348 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d3384c5d-0337-402b-be5a-7c4b862854a0 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:10:47.711698 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-d3384c5d-0337-402b-be5a-7c4b862854a0 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:10:47.719410 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d3384c5d-0337-402b-be5a-7c4b862854a0 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863" status: 200 len: 1684 microversion: 2.1 time: 0.253036 Sep 07 16:10:47.720013 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 589/1199] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:10:47 2022] GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863 => generated 1684 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:10:48.339643 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-e83a747d-8302-48c4-9d11-26e9959674e2 req-690776e0-6fa0-4957-b751-182ffa69b098 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "423140e3-a552-44fd-969a-7d215a453863", "name": "network-vif-deleted", "tag": "65a7ab29-cdc1-41e4-b419-736e34f715da"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:10:48.350511 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-e83a747d-8302-48c4-9d11-26e9959674e2 req-690776e0-6fa0-4957-b751-182ffa69b098 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:10:48.350984 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-e83a747d-8302-48c4-9d11-26e9959674e2 req-690776e0-6fa0-4957-b751-182ffa69b098 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:10:48.351408 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-e83a747d-8302-48c4-9d11-26e9959674e2 req-690776e0-6fa0-4957-b751-182ffa69b098 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:10:48.362509 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-e83a747d-8302-48c4-9d11-26e9959674e2 req-690776e0-6fa0-4957-b751-182ffa69b098 service nova] Creating event network-vif-deleted:65a7ab29-cdc1-41e4-b419-736e34f715da for instance 423140e3-a552-44fd-969a-7d215a453863 on hv-cinder-85331 Sep 07 16:10:48.368113 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-e83a747d-8302-48c4-9d11-26e9959674e2 req-690776e0-6fa0-4957-b751-182ffa69b098 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032136 Sep 07 16:10:48.369031 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 611/1200] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:10:48.742366 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f18fa3fd-b0ae-436f-9cc2-7e94f4bd2229 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:10:48.742973 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f18fa3fd-b0ae-436f-9cc2-7e94f4bd2229 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 423140e3-a552-44fd-969a-7d215a453863] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:10:48.749353 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f18fa3fd-b0ae-436f-9cc2-7e94f4bd2229 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:10:48.749829 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f18fa3fd-b0ae-436f-9cc2-7e94f4bd2229 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:10:48.750263 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f18fa3fd-b0ae-436f-9cc2-7e94f4bd2229 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:10:48.750976 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f18fa3fd-b0ae-436f-9cc2-7e94f4bd2229 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:10:48.751430 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f18fa3fd-b0ae-436f-9cc2-7e94f4bd2229 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:10:48.751883 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f18fa3fd-b0ae-436f-9cc2-7e94f4bd2229 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:10:48.783301 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f18fa3fd-b0ae-436f-9cc2-7e94f4bd2229 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:10:48.783738 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f18fa3fd-b0ae-436f-9cc2-7e94f4bd2229 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:10:48.784171 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f18fa3fd-b0ae-436f-9cc2-7e94f4bd2229 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:10:48.785273 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-f18fa3fd-b0ae-436f-9cc2-7e94f4bd2229 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lazy-loading 'fault' on Instance uuid 423140e3-a552-44fd-969a-7d215a453863 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 16:10:48.827464 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-f18fa3fd-b0ae-436f-9cc2-7e94f4bd2229 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:10:48.835717 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f18fa3fd-b0ae-436f-9cc2-7e94f4bd2229 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863" status: 200 len: 1332 microversion: 2.1 time: 0.097213 Sep 07 16:10:48.836273 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 590/1201] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:10:48 2022] GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863 => generated 1332 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:10:49.860154 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b6c5bdb1-96aa-41e0-a9f8-984ba1486c57 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:10:49.860845 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b6c5bdb1-96aa-41e0-a9f8-984ba1486c57 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 423140e3-a552-44fd-969a-7d215a453863] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:10:49.867501 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6c5bdb1-96aa-41e0-a9f8-984ba1486c57 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:10:49.867999 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6c5bdb1-96aa-41e0-a9f8-984ba1486c57 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:10:49.868430 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6c5bdb1-96aa-41e0-a9f8-984ba1486c57 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:10:49.869131 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6c5bdb1-96aa-41e0-a9f8-984ba1486c57 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:10:49.869581 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6c5bdb1-96aa-41e0-a9f8-984ba1486c57 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:10:49.869996 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b6c5bdb1-96aa-41e0-a9f8-984ba1486c57 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:10:49.882880 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-b6c5bdb1-96aa-41e0-a9f8-984ba1486c57 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] HTTP exception thrown: Instance 423140e3-a552-44fd-969a-7d215a453863 could not be found. Sep 07 16:10:49.884531 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b6c5bdb1-96aa-41e0-a9f8-984ba1486c57 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Request method failure captured: Sep 07 16:10:49.884531 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863 HTTP/1.1 Sep 07 16:10:49.884531 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept: application/json Sep 07 16:10:49.884531 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Sep 07 16:10:49.884531 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Connection: close Sep 07 16:10:49.884531 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Length: 0 Sep 07 16:10:49.884531 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Type: application/json Sep 07 16:10:49.884531 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Host: 10.222.0.17 Sep 07 16:10:49.884531 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Sep 07 16:10:49.884531 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Sep 07 16:10:49.884531 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjGMEEfdw4OUg2B39RKswOmT5z54ISjPs9Ys-pBh0gUFq_XPVQCzkiphko1MTfezgc9xGOiE9M4-fp-aoq8efmnODenpErT0vQYyVQWrBzaRRoo-wl5i6l7H-bvKljvP6w5U1cAwX2okeVPnYRC9X59Bw9YuV07_v6iRyvOmKt9QO33DU Sep 07 16:10:49.884531 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Sep 07 16:10:49.884531 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Sep 07 16:10:49.884531 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Sep 07 16:10:49.884531 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Sep 07 16:10:49.884531 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Sep 07 16:10:49.884531 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Sep 07 16:10:49.884531 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Id: ab1963a1a6684af58f5c240787788b60 Sep 07 16:10:49.884531 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-AttachVolumeNegativeTest-857872657 Sep 07 16:10:49.884531 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Role: reader,member Sep 07 16:10:49.884531 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Roles: reader,member Sep 07 16:10:49.886338 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ab1963a1a6684af58f5c240787788b60", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ab1963a1a6684af58f5c240787788b60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ab1963a1a6684af58f5c240787788b60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ab1963a1a6684af58f5c240787788b60"}]}] Sep 07 16:10:49.886338 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-AttachVolumeNegativeTest-857872657 Sep 07 16:10:49.886338 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Id: ab1963a1a6684af58f5c240787788b60 Sep 07 16:10:49.886338 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-857872657 Sep 07 16:10:49.886338 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User: tempest-AttachVolumeNegativeTest-857872657-project Sep 07 16:10:49.886338 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Sep 07 16:10:49.886338 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Sep 07 16:10:49.886338 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Id: 2dab44e593194fe788216b029eecd10c Sep 07 16:10:49.886338 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-AttachVolumeNegativeTest-857872657-project Sep 07 16:10:49.886338 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: method: > Sep 07 16:10:49.886338 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: exception: Instance 423140e3-a552-44fd-969a-7d215a453863 could not be found. Sep 07 16:10:49.886338 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: action_args: {'id': '423140e3-a552-44fd-969a-7d215a453863'} Sep 07 16:10:49.887334 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 16:10:49.887334 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:10:49.887334 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 16:10:49.887334 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 16:10:49.887334 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 16:10:49.887334 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 16:10:49.887334 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 16:10:49.887334 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 16:10:49.887334 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 16:10:49.887334 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 16:10:49.887334 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 423140e3-a552-44fd-969a-7d215a453863 could not be found. Sep 07 16:10:49.887334 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:10:49.887334 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:10:49.887334 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:10:49.887334 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:10:49.887334 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:10:49.887334 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:10:49.887334 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 16:10:49.887334 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 16:10:49.887334 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 16:10:49.889017 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 16:10:49.889017 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 16:10:49.889017 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 16:10:49.889017 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 16:10:49.889017 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 16:10:49.889017 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 16:10:49.889017 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 16:10:49.889017 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 423140e3-a552-44fd-969a-7d215a453863 could not be found. Sep 07 16:10:49.889017 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:10:49.889017 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:10:49.889017 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:10:49.889017 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:10:49.889017 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:10:49.889017 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:10:49.889017 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 16:10:49.889017 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 16:10:49.889017 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 423140e3-a552-44fd-969a-7d215a453863 could not be found. Sep 07 16:10:49.889017 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:10:49.890521 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b6c5bdb1-96aa-41e0-a9f8-984ba1486c57 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Returning 404 to user: Instance 423140e3-a552-44fd-969a-7d215a453863 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 16:10:49.890521 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b6c5bdb1-96aa-41e0-a9f8-984ba1486c57 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863" status: 404 len: 111 microversion: 2.1 time: 0.030400 Sep 07 16:10:49.890521 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 612/1202] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:10:49 2022] GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 16:10:49.895286 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3b3aa0c8-211a-4276-8ce6-194d00ca1e09 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '.version_select at 0x7ff9a5b88b80>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:10:49.917079 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3b3aa0c8-211a-4276-8ce6-194d00ca1e09 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1715222224" status: 202 len: 0 microversion: 2.1 time: 0.026120 Sep 07 16:10:49.917624 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 591/1203] 10.222.0.17 () {58 vars in 1221 bytes} [Wed Sep 7 16:10:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1715222224 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 16:10:50.524300 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0a7f4fee-59f8-409c-b79e-f79bb2bb1bc5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Action: 'create', calling method: .version_select at 0x7ff9a94e0280>, body: {"keypair": {"name": "tempest-keypair-1913017142", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFAIKOpkm73IJH4y3nKroNm4YNpVgtSMsV3+mugz0lL/r8z/kpJoJUZ9Yktl80kYVUl9Grj9A867iMVQjLWKtgHWQXqLg4huUeOAPyyz1skbj3LE6SW10K6//u3CUHfhTQ=="}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:10:50.539166 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-0a7f4fee-59f8-409c-b79e-f79bb2bb1bc5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Getting quotas for project ab1963a1a6684af58f5c240787788b60. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 16:10:50.542917 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.quota [None req-0a7f4fee-59f8-409c-b79e-f79bb2bb1bc5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Getting quotas for user 2dab44e593194fe788216b029eecd10c and project ab1963a1a6684af58f5c240787788b60. Resources: {'key_pairs'} {{(pid=120640) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 16:10:50.564237 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0a7f4fee-59f8-409c-b79e-f79bb2bb1bc5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043838 Sep 07 16:10:50.564858 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 613/1204] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Sep 7 16:10:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:10:51.759069 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0622dc8e-f958-4fa6-b2e6-4a2b6d78fabd tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1751902349", "imageRef": "cfe19284-9779-46f4-b458-81d5475ec82f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "de0a3fba-a9f9-45bf-aa74-cb5014a191cb"}], "security_groups": [{"name": "tempest-securitygroup--554292395"}], "key_name": "tempest-keypair-1913017142", "user_data": "}} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:10:51.864647 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.network.neutron [None req-0622dc8e-f958-4fa6-b2e6-4a2b6d78fabd tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] validate_networks() for [('de0a3fba-a9f9-45bf-aa74-cb5014a191cb', None, None, None, None, None)] {{(pid=120641) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 16:10:52.226875 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-0622dc8e-f958-4fa6-b2e6-4a2b6d78fabd tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Flavor limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 16:10:52.227298 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-0622dc8e-f958-4fa6-b2e6-4a2b6d78fabd tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Image limits 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 16:10:52.227799 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-0622dc8e-f958-4fa6-b2e6-4a2b6d78fabd tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Flavor pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 16:10:52.228208 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-0622dc8e-f958-4fa6-b2e6-4a2b6d78fabd tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Image pref 0:0:0 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 16:10:52.228617 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.virt.hardware [None req-0622dc8e-f958-4fa6-b2e6-4a2b6d78fabd tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 16:10:52.237333 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0622dc8e-f958-4fa6-b2e6-4a2b6d78fabd tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:10:52.238342 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0622dc8e-f958-4fa6-b2e6-4a2b6d78fabd tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:10:52.238779 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0622dc8e-f958-4fa6-b2e6-4a2b6d78fabd tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:10:52.239495 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0622dc8e-f958-4fa6-b2e6-4a2b6d78fabd tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:10:52.239969 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0622dc8e-f958-4fa6-b2e6-4a2b6d78fabd tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:10:52.240417 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0622dc8e-f958-4fa6-b2e6-4a2b6d78fabd tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:10:52.257386 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.quota [None req-0622dc8e-f958-4fa6-b2e6-4a2b6d78fabd tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Getting quotas for project ab1963a1a6684af58f5c240787788b60. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 16:10:52.261332 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.quota [None req-0622dc8e-f958-4fa6-b2e6-4a2b6d78fabd tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Getting quotas for user 2dab44e593194fe788216b029eecd10c and project ab1963a1a6684af58f5c240787788b60. Resources: {'cores', 'instances', 'ram'} {{(pid=120641) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 16:10:52.272294 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0622dc8e-f958-4fa6-b2e6-4a2b6d78fabd tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Going to run 1 instances... {{(pid=120641) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 16:10:52.274555 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0622dc8e-f958-4fa6-b2e6-4a2b6d78fabd tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 039917c5-d07d-48cc-8a1e-14b973a93bb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cfe19284-9779-46f4-b458-81d5475ec82f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 16:10:52.321814 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0622dc8e-f958-4fa6-b2e6-4a2b6d78fabd tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.567547 Sep 07 16:10:52.322458 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 592/1205] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Sep 7 16:10:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 16:10:52.333973 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-85b3c9bc-8b44-447a-8836-9cb7f9e86fa4 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:10:52.334592 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-85b3c9bc-8b44-447a-8836-9cb7f9e86fa4 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 039917c5-d07d-48cc-8a1e-14b973a93bb9] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:10:52.392567 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-85b3c9bc-8b44-447a-8836-9cb7f9e86fa4 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:10:52.399280 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-85b3c9bc-8b44-447a-8836-9cb7f9e86fa4 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/039917c5-d07d-48cc-8a1e-14b973a93bb9" status: 200 len: 1242 microversion: 2.1 time: 0.069559 Sep 07 16:10:52.399871 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 614/1206] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:10:52 2022] GET /compute/v2.1/servers/039917c5-d07d-48cc-8a1e-14b973a93bb9 => generated 1242 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:10:53.422294 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e5040a26-ef54-490b-8a3b-cf845e2b02f5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:10:53.422933 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e5040a26-ef54-490b-8a3b-cf845e2b02f5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 039917c5-d07d-48cc-8a1e-14b973a93bb9] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:10:53.429016 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e5040a26-ef54-490b-8a3b-cf845e2b02f5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:10:53.429494 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e5040a26-ef54-490b-8a3b-cf845e2b02f5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:10:53.429923 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e5040a26-ef54-490b-8a3b-cf845e2b02f5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:10:53.430608 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e5040a26-ef54-490b-8a3b-cf845e2b02f5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:10:53.431054 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e5040a26-ef54-490b-8a3b-cf845e2b02f5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:10:53.431472 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e5040a26-ef54-490b-8a3b-cf845e2b02f5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:10:53.617151 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-e5040a26-ef54-490b-8a3b-cf845e2b02f5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:10:53.625243 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e5040a26-ef54-490b-8a3b-cf845e2b02f5 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/039917c5-d07d-48cc-8a1e-14b973a93bb9" status: 200 len: 1294 microversion: 2.1 time: 0.207174 Sep 07 16:10:53.626187 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 593/1207] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:10:53 2022] GET /compute/v2.1/servers/039917c5-d07d-48cc-8a1e-14b973a93bb9 => generated 1294 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:10:54.649637 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4cfd36d6-c0e7-4e3c-a95d-fa7e39ebc43d tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:10:54.650272 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4cfd36d6-c0e7-4e3c-a95d-fa7e39ebc43d tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 039917c5-d07d-48cc-8a1e-14b973a93bb9] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:10:54.656911 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4cfd36d6-c0e7-4e3c-a95d-fa7e39ebc43d tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:10:54.657500 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4cfd36d6-c0e7-4e3c-a95d-fa7e39ebc43d tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:10:54.658007 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4cfd36d6-c0e7-4e3c-a95d-fa7e39ebc43d tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:10:54.658773 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4cfd36d6-c0e7-4e3c-a95d-fa7e39ebc43d tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:10:54.660017 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4cfd36d6-c0e7-4e3c-a95d-fa7e39ebc43d tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:10:54.660518 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4cfd36d6-c0e7-4e3c-a95d-fa7e39ebc43d tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:10:54.795313 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-4cfd36d6-c0e7-4e3c-a95d-fa7e39ebc43d tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:10:54.803234 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4cfd36d6-c0e7-4e3c-a95d-fa7e39ebc43d tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/039917c5-d07d-48cc-8a1e-14b973a93bb9" status: 200 len: 1367 microversion: 2.1 time: 0.157597 Sep 07 16:10:54.803935 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 615/1208] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:10:54 2022] GET /compute/v2.1/servers/039917c5-d07d-48cc-8a1e-14b973a93bb9 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:10:54.963978 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-8f02abeb-c3b8-4c8e-9bd4-b98ace038c71 req-d1d2ee39-e8ea-4961-9b1d-bddbeae691dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "039917c5-d07d-48cc-8a1e-14b973a93bb9", "tag": "f935c961-dcc5-4306-81b5-00a57795c87a"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:10:54.975764 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-8f02abeb-c3b8-4c8e-9bd4-b98ace038c71 req-d1d2ee39-e8ea-4961-9b1d-bddbeae691dc service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:10:54.976249 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-8f02abeb-c3b8-4c8e-9bd4-b98ace038c71 req-d1d2ee39-e8ea-4961-9b1d-bddbeae691dc service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:10:54.976677 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-8f02abeb-c3b8-4c8e-9bd4-b98ace038c71 req-d1d2ee39-e8ea-4961-9b1d-bddbeae691dc service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:10:54.989270 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-8f02abeb-c3b8-4c8e-9bd4-b98ace038c71 req-d1d2ee39-e8ea-4961-9b1d-bddbeae691dc service nova] Creating event network-changed:f935c961-dcc5-4306-81b5-00a57795c87a for instance 039917c5-d07d-48cc-8a1e-14b973a93bb9 on hv-cinder-85331 Sep 07 16:10:54.994270 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-8f02abeb-c3b8-4c8e-9bd4-b98ace038c71 req-d1d2ee39-e8ea-4961-9b1d-bddbeae691dc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034193 Sep 07 16:10:54.994863 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 594/1209] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:10:55.826442 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-57bc4070-997b-41a6-83b3-20def681fa23 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:10:55.827048 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-57bc4070-997b-41a6-83b3-20def681fa23 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 039917c5-d07d-48cc-8a1e-14b973a93bb9] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:10:55.834117 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-57bc4070-997b-41a6-83b3-20def681fa23 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:10:55.834592 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-57bc4070-997b-41a6-83b3-20def681fa23 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:10:55.835026 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-57bc4070-997b-41a6-83b3-20def681fa23 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:10:55.835739 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-57bc4070-997b-41a6-83b3-20def681fa23 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:10:55.836191 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-57bc4070-997b-41a6-83b3-20def681fa23 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:10:55.836614 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-57bc4070-997b-41a6-83b3-20def681fa23 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:10:56.017853 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-57bc4070-997b-41a6-83b3-20def681fa23 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:10:56.025420 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-57bc4070-997b-41a6-83b3-20def681fa23 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/039917c5-d07d-48cc-8a1e-14b973a93bb9" status: 200 len: 1367 microversion: 2.1 time: 0.202801 Sep 07 16:10:56.025986 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 616/1210] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:10:55 2022] GET /compute/v2.1/servers/039917c5-d07d-48cc-8a1e-14b973a93bb9 => generated 1367 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:10:57.049287 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-88666e68-dcb5-4eee-9fd9-d19aadacc622 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:10:57.049985 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-88666e68-dcb5-4eee-9fd9-d19aadacc622 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 039917c5-d07d-48cc-8a1e-14b973a93bb9] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:10:57.056040 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-88666e68-dcb5-4eee-9fd9-d19aadacc622 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:10:57.056517 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-88666e68-dcb5-4eee-9fd9-d19aadacc622 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:10:57.056969 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-88666e68-dcb5-4eee-9fd9-d19aadacc622 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:10:57.057649 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-88666e68-dcb5-4eee-9fd9-d19aadacc622 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:10:57.058091 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-88666e68-dcb5-4eee-9fd9-d19aadacc622 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:10:57.058508 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-88666e68-dcb5-4eee-9fd9-d19aadacc622 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:10:57.186355 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-88666e68-dcb5-4eee-9fd9-d19aadacc622 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:10:57.194397 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-88666e68-dcb5-4eee-9fd9-d19aadacc622 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/039917c5-d07d-48cc-8a1e-14b973a93bb9" status: 200 len: 1367 microversion: 2.1 time: 0.150017 Sep 07 16:10:57.194951 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 595/1211] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:10:57 2022] GET /compute/v2.1/servers/039917c5-d07d-48cc-8a1e-14b973a93bb9 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:10:58.217716 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e97fe993-a5cc-424a-b064-b64ed2028d2a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:10:58.218270 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e97fe993-a5cc-424a-b064-b64ed2028d2a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 039917c5-d07d-48cc-8a1e-14b973a93bb9] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:10:58.225109 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e97fe993-a5cc-424a-b064-b64ed2028d2a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:10:58.225582 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e97fe993-a5cc-424a-b064-b64ed2028d2a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:10:58.226007 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e97fe993-a5cc-424a-b064-b64ed2028d2a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:10:58.226792 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e97fe993-a5cc-424a-b064-b64ed2028d2a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:10:58.227282 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e97fe993-a5cc-424a-b064-b64ed2028d2a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:10:58.227733 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e97fe993-a5cc-424a-b064-b64ed2028d2a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:10:58.354905 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e97fe993-a5cc-424a-b064-b64ed2028d2a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:10:58.363462 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e97fe993-a5cc-424a-b064-b64ed2028d2a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/039917c5-d07d-48cc-8a1e-14b973a93bb9" status: 200 len: 1367 microversion: 2.1 time: 0.149770 Sep 07 16:10:58.364046 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 617/1212] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:10:58 2022] GET /compute/v2.1/servers/039917c5-d07d-48cc-8a1e-14b973a93bb9 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:10:59.386419 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b052ccae-f154-4eca-bd9b-360d4ead23dd tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:10:59.386990 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-b052ccae-f154-4eca-bd9b-360d4ead23dd tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 039917c5-d07d-48cc-8a1e-14b973a93bb9] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:10:59.393316 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b052ccae-f154-4eca-bd9b-360d4ead23dd tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:10:59.394379 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b052ccae-f154-4eca-bd9b-360d4ead23dd tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:10:59.394805 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b052ccae-f154-4eca-bd9b-360d4ead23dd tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:10:59.395480 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b052ccae-f154-4eca-bd9b-360d4ead23dd tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:10:59.395955 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b052ccae-f154-4eca-bd9b-360d4ead23dd tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:10:59.396371 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-b052ccae-f154-4eca-bd9b-360d4ead23dd tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:10:59.525182 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-b052ccae-f154-4eca-bd9b-360d4ead23dd tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:10:59.532650 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b052ccae-f154-4eca-bd9b-360d4ead23dd tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/039917c5-d07d-48cc-8a1e-14b973a93bb9" status: 200 len: 1367 microversion: 2.1 time: 0.150104 Sep 07 16:10:59.533204 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 596/1213] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:10:59 2022] GET /compute/v2.1/servers/039917c5-d07d-48cc-8a1e-14b973a93bb9 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:11:00.554133 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6c63e614-d365-462b-ad4e-01d696605b4b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:11:00.554742 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6c63e614-d365-462b-ad4e-01d696605b4b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 039917c5-d07d-48cc-8a1e-14b973a93bb9] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:11:00.561454 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6c63e614-d365-462b-ad4e-01d696605b4b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:00.561925 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6c63e614-d365-462b-ad4e-01d696605b4b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:00.562354 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6c63e614-d365-462b-ad4e-01d696605b4b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:00.563039 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6c63e614-d365-462b-ad4e-01d696605b4b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:00.563480 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6c63e614-d365-462b-ad4e-01d696605b4b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:00.563935 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6c63e614-d365-462b-ad4e-01d696605b4b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:00.687884 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-ac5d3f72-1578-451f-b015-c3c95fda0475 req-1cb5350d-b169-47da-b29c-2e42d7b2a622 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "039917c5-d07d-48cc-8a1e-14b973a93bb9", "name": "network-vif-plugged", "status": "completed", "tag": "f935c961-dcc5-4306-81b5-00a57795c87a"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:11:00.699051 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-ac5d3f72-1578-451f-b015-c3c95fda0475 req-1cb5350d-b169-47da-b29c-2e42d7b2a622 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:00.699781 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-ac5d3f72-1578-451f-b015-c3c95fda0475 req-1cb5350d-b169-47da-b29c-2e42d7b2a622 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:00.700686 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-ac5d3f72-1578-451f-b015-c3c95fda0475 req-1cb5350d-b169-47da-b29c-2e42d7b2a622 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:00.703135 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6c63e614-d365-462b-ad4e-01d696605b4b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:11:00.712001 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6c63e614-d365-462b-ad4e-01d696605b4b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/039917c5-d07d-48cc-8a1e-14b973a93bb9" status: 200 len: 1367 microversion: 2.1 time: 0.161599 Sep 07 16:11:00.713335 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-ac5d3f72-1578-451f-b015-c3c95fda0475 req-1cb5350d-b169-47da-b29c-2e42d7b2a622 service nova] Creating event network-vif-plugged:f935c961-dcc5-4306-81b5-00a57795c87a for instance 039917c5-d07d-48cc-8a1e-14b973a93bb9 on hv-cinder-85331 Sep 07 16:11:00.718222 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-ac5d3f72-1578-451f-b015-c3c95fda0475 req-1cb5350d-b169-47da-b29c-2e42d7b2a622 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034146 Sep 07 16:11:00.718797 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 597/1214] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:11:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 16:11:00.725383 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 618/1215] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:11:00 2022] GET /compute/v2.1/servers/039917c5-d07d-48cc-8a1e-14b973a93bb9 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:11:01.737057 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-4079643c-f08a-49dd-84a8-2be0fe037766 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:11:01.738333 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-4079643c-f08a-49dd-84a8-2be0fe037766 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 039917c5-d07d-48cc-8a1e-14b973a93bb9] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:11:01.744598 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4079643c-f08a-49dd-84a8-2be0fe037766 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:01.745082 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4079643c-f08a-49dd-84a8-2be0fe037766 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:01.745523 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4079643c-f08a-49dd-84a8-2be0fe037766 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:01.746209 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4079643c-f08a-49dd-84a8-2be0fe037766 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:01.746669 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4079643c-f08a-49dd-84a8-2be0fe037766 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:01.747093 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-4079643c-f08a-49dd-84a8-2be0fe037766 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:01.872763 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-4079643c-f08a-49dd-84a8-2be0fe037766 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:11:01.880398 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-4079643c-f08a-49dd-84a8-2be0fe037766 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/039917c5-d07d-48cc-8a1e-14b973a93bb9" status: 200 len: 1367 microversion: 2.1 time: 0.148024 Sep 07 16:11:01.880964 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 598/1216] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:11:01 2022] GET /compute/v2.1/servers/039917c5-d07d-48cc-8a1e-14b973a93bb9 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:11:02.903610 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-5b0b3e89-e756-4b33-8ef5-e08c485dc36b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:11:02.904158 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-5b0b3e89-e756-4b33-8ef5-e08c485dc36b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 039917c5-d07d-48cc-8a1e-14b973a93bb9] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:11:02.906509 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell0:SELECT=6 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:02.911896 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b0b3e89-e756-4b33-8ef5-e08c485dc36b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:02.912368 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b0b3e89-e756-4b33-8ef5-e08c485dc36b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:02.912798 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b0b3e89-e756-4b33-8ef5-e08c485dc36b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:02.913471 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b0b3e89-e756-4b33-8ef5-e08c485dc36b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:02.913916 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b0b3e89-e756-4b33-8ef5-e08c485dc36b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:02.914332 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-5b0b3e89-e756-4b33-8ef5-e08c485dc36b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:03.039701 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-5b0b3e89-e756-4b33-8ef5-e08c485dc36b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:11:03.047215 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-5b0b3e89-e756-4b33-8ef5-e08c485dc36b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/039917c5-d07d-48cc-8a1e-14b973a93bb9" status: 200 len: 1558 microversion: 2.1 time: 0.147509 Sep 07 16:11:03.047812 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 619/1217] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:11:02 2022] GET /compute/v2.1/servers/039917c5-d07d-48cc-8a1e-14b973a93bb9 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:11:03.070147 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-64a91a54-619e-4271-8488-3d91a3a6b3b3 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:11:03.070681 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-64a91a54-619e-4271-8488-3d91a3a6b3b3 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 039917c5-d07d-48cc-8a1e-14b973a93bb9] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:11:03.072658 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:03.073311 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell0:SELECT=6 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:03.079669 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-64a91a54-619e-4271-8488-3d91a3a6b3b3 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:03.080150 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-64a91a54-619e-4271-8488-3d91a3a6b3b3 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:03.080586 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-64a91a54-619e-4271-8488-3d91a3a6b3b3 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:03.081273 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-64a91a54-619e-4271-8488-3d91a3a6b3b3 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:03.081754 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-64a91a54-619e-4271-8488-3d91a3a6b3b3 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:03.082176 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-64a91a54-619e-4271-8488-3d91a3a6b3b3 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:03.164739 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-64a91a54-619e-4271-8488-3d91a3a6b3b3 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/039917c5-d07d-48cc-8a1e-14b973a93bb9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098421 Sep 07 16:11:03.165327 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 599/1218] 10.222.0.17 () {58 vars in 1275 bytes} [Wed Sep 7 16:11:03 2022] GET /compute/v2.1/servers/039917c5-d07d-48cc-8a1e-14b973a93bb9/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:11:04.311627 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-21559936-0e99-4eab-a806-3f50a04f0fa0 req-b45205ee-3792-4080-a976-6eafb72a08db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "039917c5-d07d-48cc-8a1e-14b973a93bb9", "tag": "f935c961-dcc5-4306-81b5-00a57795c87a"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:11:04.322912 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-21559936-0e99-4eab-a806-3f50a04f0fa0 req-b45205ee-3792-4080-a976-6eafb72a08db service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:04.323385 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-21559936-0e99-4eab-a806-3f50a04f0fa0 req-b45205ee-3792-4080-a976-6eafb72a08db service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:04.323844 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-21559936-0e99-4eab-a806-3f50a04f0fa0 req-b45205ee-3792-4080-a976-6eafb72a08db service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:04.334864 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-21559936-0e99-4eab-a806-3f50a04f0fa0 req-b45205ee-3792-4080-a976-6eafb72a08db service nova] Creating event network-changed:f935c961-dcc5-4306-81b5-00a57795c87a for instance 039917c5-d07d-48cc-8a1e-14b973a93bb9 on hv-cinder-85331 Sep 07 16:11:04.339903 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-21559936-0e99-4eab-a806-3f50a04f0fa0 req-b45205ee-3792-4080-a976-6eafb72a08db service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031977 Sep 07 16:11:04.340502 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 620/1219] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:11:11.056757 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-5aa273a5-bf3a-4ff3-8ffc-8e67fd83d993 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:11:11.057254 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5aa273a5-bf3a-4ff3-8ffc-8e67fd83d993 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 6631be10-20b4-46ba-acd7-f78070cf384d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:11:11.059197 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-23470c8d-999f-4a80-b7c6-e0d621856663 req-8db3fd68-c3d5-4979-8d57-edc1981b5532 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6631be10-20b4-46ba-acd7-f78070cf384d", "tag": "967b7d4c-12d8-4ab7-bdab-2c385d5d8e50"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:11:11.059676 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:11.065466 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5aa273a5-bf3a-4ff3-8ffc-8e67fd83d993 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:11.065960 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5aa273a5-bf3a-4ff3-8ffc-8e67fd83d993 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:11.066397 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5aa273a5-bf3a-4ff3-8ffc-8e67fd83d993 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:11.067099 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5aa273a5-bf3a-4ff3-8ffc-8e67fd83d993 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:11.067613 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5aa273a5-bf3a-4ff3-8ffc-8e67fd83d993 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:11.068043 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-5aa273a5-bf3a-4ff3-8ffc-8e67fd83d993 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:11.072750 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-23470c8d-999f-4a80-b7c6-e0d621856663 req-8db3fd68-c3d5-4979-8d57-edc1981b5532 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:11.074530 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-23470c8d-999f-4a80-b7c6-e0d621856663 req-8db3fd68-c3d5-4979-8d57-edc1981b5532 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:11.074661 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:11.074776 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-23470c8d-999f-4a80-b7c6-e0d621856663 req-8db3fd68-c3d5-4979-8d57-edc1981b5532 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:11.085773 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-23470c8d-999f-4a80-b7c6-e0d621856663 req-8db3fd68-c3d5-4979-8d57-edc1981b5532 service nova] Creating event network-changed:967b7d4c-12d8-4ab7-bdab-2c385d5d8e50 for instance 6631be10-20b4-46ba-acd7-f78070cf384d on hv-cinder-85331 Sep 07 16:11:11.091577 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-23470c8d-999f-4a80-b7c6-e0d621856663 req-8db3fd68-c3d5-4979-8d57-edc1981b5532 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036760 Sep 07 16:11:11.093346 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 621/1220] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 16:11:11.101683 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-5aa273a5-bf3a-4ff3-8ffc-8e67fd83d993 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 6631be10-20b4-46ba-acd7-f78070cf384d] Going to try to terminate instance {{(pid=120641) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 16:11:11.195033 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-5aa273a5-bf3a-4ff3-8ffc-8e67fd83d993 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d" status: 204 len: 0 microversion: 2.1 time: 0.142048 Sep 07 16:11:11.196359 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 600/1221] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Sep 7 16:11:11 2022] DELETE /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 16:11:11.205050 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b06ded1c-75a9-4ac2-b796-14cc53ed3f98 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:11:11.206101 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b06ded1c-75a9-4ac2-b796-14cc53ed3f98 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 6631be10-20b4-46ba-acd7-f78070cf384d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:11:11.212334 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b06ded1c-75a9-4ac2-b796-14cc53ed3f98 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:11.212816 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b06ded1c-75a9-4ac2-b796-14cc53ed3f98 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:11.213252 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b06ded1c-75a9-4ac2-b796-14cc53ed3f98 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:11.213944 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b06ded1c-75a9-4ac2-b796-14cc53ed3f98 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:11.214450 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b06ded1c-75a9-4ac2-b796-14cc53ed3f98 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:11.214904 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b06ded1c-75a9-4ac2-b796-14cc53ed3f98 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:11.346396 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b06ded1c-75a9-4ac2-b796-14cc53ed3f98 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:11:11.354623 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b06ded1c-75a9-4ac2-b796-14cc53ed3f98 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d" status: 200 len: 1576 microversion: 2.1 time: 0.154029 Sep 07 16:11:11.355389 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 622/1222] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:11:11 2022] GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:11:12.379069 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-74fd0548-20f6-4e02-b9ad-57e3f37bd8dc tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:11:12.380500 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-74fd0548-20f6-4e02-b9ad-57e3f37bd8dc tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 6631be10-20b4-46ba-acd7-f78070cf384d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:11:12.387282 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-74fd0548-20f6-4e02-b9ad-57e3f37bd8dc tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:12.388049 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-74fd0548-20f6-4e02-b9ad-57e3f37bd8dc tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:12.388486 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-74fd0548-20f6-4e02-b9ad-57e3f37bd8dc tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:12.389222 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-74fd0548-20f6-4e02-b9ad-57e3f37bd8dc tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:12.389676 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-74fd0548-20f6-4e02-b9ad-57e3f37bd8dc tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:12.390411 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-74fd0548-20f6-4e02-b9ad-57e3f37bd8dc tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:12.587310 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-74fd0548-20f6-4e02-b9ad-57e3f37bd8dc tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:11:12.595048 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-74fd0548-20f6-4e02-b9ad-57e3f37bd8dc tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d" status: 200 len: 1576 microversion: 2.1 time: 0.220322 Sep 07 16:11:12.595899 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 601/1223] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:11:12 2022] GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d => generated 1576 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:11:13.619968 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f0328030-72a3-4db0-973e-8571c308d6b2 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:11:13.624075 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f0328030-72a3-4db0-973e-8571c308d6b2 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 6631be10-20b4-46ba-acd7-f78070cf384d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:11:13.626815 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:13.633351 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0328030-72a3-4db0-973e-8571c308d6b2 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:13.633839 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0328030-72a3-4db0-973e-8571c308d6b2 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:13.634274 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0328030-72a3-4db0-973e-8571c308d6b2 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:13.634966 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0328030-72a3-4db0-973e-8571c308d6b2 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:13.635428 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0328030-72a3-4db0-973e-8571c308d6b2 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:13.635887 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f0328030-72a3-4db0-973e-8571c308d6b2 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:13.641095 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:13.850296 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f0328030-72a3-4db0-973e-8571c308d6b2 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:11:13.859034 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f0328030-72a3-4db0-973e-8571c308d6b2 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d" status: 200 len: 1457 microversion: 2.1 time: 0.243064 Sep 07 16:11:13.859749 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 623/1224] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:11:13 2022] GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d => generated 1457 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:11:13.906493 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-863aa7a2-0209-4bca-9965-0ac6eb21c230 req-ff93bbd2-d45d-41e4-a820-2df9ba2a3908 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6631be10-20b4-46ba-acd7-f78070cf384d", "name": "network-vif-deleted", "tag": "967b7d4c-12d8-4ab7-bdab-2c385d5d8e50"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:11:13.917643 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-863aa7a2-0209-4bca-9965-0ac6eb21c230 req-ff93bbd2-d45d-41e4-a820-2df9ba2a3908 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:13.918114 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-863aa7a2-0209-4bca-9965-0ac6eb21c230 req-ff93bbd2-d45d-41e4-a820-2df9ba2a3908 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:13.918539 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-863aa7a2-0209-4bca-9965-0ac6eb21c230 req-ff93bbd2-d45d-41e4-a820-2df9ba2a3908 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:13.929630 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-863aa7a2-0209-4bca-9965-0ac6eb21c230 req-ff93bbd2-d45d-41e4-a820-2df9ba2a3908 service nova] Creating event network-vif-deleted:967b7d4c-12d8-4ab7-bdab-2c385d5d8e50 for instance 6631be10-20b4-46ba-acd7-f78070cf384d on hv-cinder-85331 Sep 07 16:11:13.934390 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-863aa7a2-0209-4bca-9965-0ac6eb21c230 req-ff93bbd2-d45d-41e4-a820-2df9ba2a3908 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031564 Sep 07 16:11:13.934961 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 602/1225] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:11:14.882808 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4161e90e-8d8e-4da2-962f-bf40cd2ab798 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:11:14.883447 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4161e90e-8d8e-4da2-962f-bf40cd2ab798 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 6631be10-20b4-46ba-acd7-f78070cf384d] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:11:14.889800 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4161e90e-8d8e-4da2-962f-bf40cd2ab798 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:14.890238 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4161e90e-8d8e-4da2-962f-bf40cd2ab798 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:14.890668 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4161e90e-8d8e-4da2-962f-bf40cd2ab798 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:14.891348 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4161e90e-8d8e-4da2-962f-bf40cd2ab798 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:14.891867 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4161e90e-8d8e-4da2-962f-bf40cd2ab798 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:14.892234 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4161e90e-8d8e-4da2-962f-bf40cd2ab798 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:14.922555 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4161e90e-8d8e-4da2-962f-bf40cd2ab798 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:14.923027 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4161e90e-8d8e-4da2-962f-bf40cd2ab798 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:14.923459 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4161e90e-8d8e-4da2-962f-bf40cd2ab798 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:14.923941 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-4161e90e-8d8e-4da2-962f-bf40cd2ab798 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lazy-loading 'fault' on Instance uuid 6631be10-20b4-46ba-acd7-f78070cf384d {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 16:11:14.964755 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-4161e90e-8d8e-4da2-962f-bf40cd2ab798 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:11:14.973111 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4161e90e-8d8e-4da2-962f-bf40cd2ab798 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d" status: 200 len: 1229 microversion: 2.1 time: 0.094003 Sep 07 16:11:14.973753 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 624/1226] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:11:14 2022] GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d => generated 1229 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:11:15.998080 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-946dd7b7-26f2-46cd-b946-6858afb637ee tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:11:15.998774 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-946dd7b7-26f2-46cd-b946-6858afb637ee tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 6631be10-20b4-46ba-acd7-f78070cf384d] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:11:16.005414 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-946dd7b7-26f2-46cd-b946-6858afb637ee tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:16.005897 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-946dd7b7-26f2-46cd-b946-6858afb637ee tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:16.006327 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-946dd7b7-26f2-46cd-b946-6858afb637ee tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:16.007003 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-946dd7b7-26f2-46cd-b946-6858afb637ee tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:16.007453 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-946dd7b7-26f2-46cd-b946-6858afb637ee tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:16.007906 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-946dd7b7-26f2-46cd-b946-6858afb637ee tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:16.021347 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-946dd7b7-26f2-46cd-b946-6858afb637ee tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] HTTP exception thrown: Instance 6631be10-20b4-46ba-acd7-f78070cf384d could not be found. Sep 07 16:11:16.022947 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-946dd7b7-26f2-46cd-b946-6858afb637ee tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Request method failure captured: Sep 07 16:11:16.022947 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d HTTP/1.1 Sep 07 16:11:16.022947 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Accept: application/json Sep 07 16:11:16.022947 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Accept-Encoding: identity Sep 07 16:11:16.022947 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Connection: close Sep 07 16:11:16.022947 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Content-Length: 0 Sep 07 16:11:16.022947 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Content-Type: application/json Sep 07 16:11:16.022947 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Host: 10.222.0.17 Sep 07 16:11:16.022947 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Openstack-System-Scope: None Sep 07 16:11:16.022947 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Sep 07 16:11:16.022947 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjGMCaCWK5xf9_Qvk5IFgMfJDHID5TkXXoesVdgbHz0eEjX3zQJhIE6W6YFFA1AfRDMFZ9pjH-yhGyY7LOqC3Xi0awLaiFlAJwwC4L0zaoaV9ooyG1X0vA8TJJ6eSQzSsQMIz7yVkLc_Y3LHczdQ2YmI0aHfl5iA-Qj_Bve7Ps3248I00 Sep 07 16:11:16.022947 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Domain-Id: None Sep 07 16:11:16.022947 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Domain-Name: None Sep 07 16:11:16.022947 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Identity-Status: Confirmed Sep 07 16:11:16.022947 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Is-Admin-Project: True Sep 07 16:11:16.022947 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Domain-Id: default Sep 07 16:11:16.022947 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Domain-Name: Default Sep 07 16:11:16.022947 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Id: 6ef2c5a9809b4bee95a171cf6dca4e2b Sep 07 16:11:16.022947 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Name: tempest-TestVolumeBootPattern-1462709202 Sep 07 16:11:16.022947 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Role: reader,member Sep 07 16:11:16.022947 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Roles: reader,member Sep 07 16:11:16.024854 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6ef2c5a9809b4bee95a171cf6dca4e2b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6ef2c5a9809b4bee95a171cf6dca4e2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6ef2c5a9809b4bee95a171cf6dca4e2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6ef2c5a9809b4bee95a171cf6dca4e2b"}]}] Sep 07 16:11:16.024854 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant: tempest-TestVolumeBootPattern-1462709202 Sep 07 16:11:16.024854 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant-Id: 6ef2c5a9809b4bee95a171cf6dca4e2b Sep 07 16:11:16.024854 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant-Name: tempest-TestVolumeBootPattern-1462709202 Sep 07 16:11:16.024854 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User: tempest-TestVolumeBootPattern-1462709202-project Sep 07 16:11:16.024854 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Domain-Id: default Sep 07 16:11:16.024854 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Domain-Name: Default Sep 07 16:11:16.024854 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Id: d595f32b5f2d406b9d6ce62acec1456b Sep 07 16:11:16.024854 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Name: tempest-TestVolumeBootPattern-1462709202-project Sep 07 16:11:16.024854 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: method: > Sep 07 16:11:16.024854 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: exception: Instance 6631be10-20b4-46ba-acd7-f78070cf384d could not be found. Sep 07 16:11:16.024854 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: action_args: {'id': '6631be10-20b4-46ba-acd7-f78070cf384d'} Sep 07 16:11:16.025910 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 16:11:16.025910 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:11:16.025910 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 16:11:16.025910 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 16:11:16.025910 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 16:11:16.025910 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 16:11:16.025910 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 16:11:16.025910 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 16:11:16.025910 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 16:11:16.025910 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 16:11:16.025910 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6631be10-20b4-46ba-acd7-f78070cf384d could not be found. Sep 07 16:11:16.025910 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:11:16.025910 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:11:16.025910 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:11:16.025910 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:11:16.025910 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:11:16.025910 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:11:16.025910 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 16:11:16.025910 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 16:11:16.025910 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 16:11:16.027263 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 16:11:16.027263 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 16:11:16.027263 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 16:11:16.027263 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 16:11:16.027263 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 16:11:16.027263 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 16:11:16.027263 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 16:11:16.027263 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6631be10-20b4-46ba-acd7-f78070cf384d could not be found. Sep 07 16:11:16.027263 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:11:16.027263 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:11:16.027263 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:11:16.027263 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:11:16.027263 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:11:16.027263 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:11:16.027263 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 16:11:16.027263 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 16:11:16.027263 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6631be10-20b4-46ba-acd7-f78070cf384d could not be found. Sep 07 16:11:16.027263 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:11:16.029075 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-946dd7b7-26f2-46cd-b946-6858afb637ee tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Returning 404 to user: Instance 6631be10-20b4-46ba-acd7-f78070cf384d could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 16:11:16.029075 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-946dd7b7-26f2-46cd-b946-6858afb637ee tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d" status: 404 len: 111 microversion: 2.1 time: 0.030978 Sep 07 16:11:16.029075 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 603/1227] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:11:15 2022] GET /compute/v2.1/servers/6631be10-20b4-46ba-acd7-f78070cf384d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 16:11:19.060533 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-08de60f7-6f73-4b5f-8631-c1212090e5cc tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:11:19.061132 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-08de60f7-6f73-4b5f-8631-c1212090e5cc tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 1d450d23-ad9c-43d6-a4dc-6e5c48e5292b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:11:19.063868 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-ce3f1faa-09c7-4092-914a-72a9beccb2c8 req-f8e2ea56-29dc-4eb1-844e-f7f3a565543a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d450d23-ad9c-43d6-a4dc-6e5c48e5292b", "tag": "bf299e5b-1f8a-4cd6-b75a-8eb1d78dc72b"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:11:19.073957 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-ce3f1faa-09c7-4092-914a-72a9beccb2c8 req-f8e2ea56-29dc-4eb1-844e-f7f3a565543a service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:19.077342 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08de60f7-6f73-4b5f-8631-c1212090e5cc tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:19.077823 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08de60f7-6f73-4b5f-8631-c1212090e5cc tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:19.078255 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08de60f7-6f73-4b5f-8631-c1212090e5cc tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:19.079032 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08de60f7-6f73-4b5f-8631-c1212090e5cc tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:19.079482 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08de60f7-6f73-4b5f-8631-c1212090e5cc tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:19.079925 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-08de60f7-6f73-4b5f-8631-c1212090e5cc tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:19.084927 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-ce3f1faa-09c7-4092-914a-72a9beccb2c8 req-f8e2ea56-29dc-4eb1-844e-f7f3a565543a service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:19.085371 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-ce3f1faa-09c7-4092-914a-72a9beccb2c8 req-f8e2ea56-29dc-4eb1-844e-f7f3a565543a service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:19.097221 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-ce3f1faa-09c7-4092-914a-72a9beccb2c8 req-f8e2ea56-29dc-4eb1-844e-f7f3a565543a service nova] Creating event network-changed:bf299e5b-1f8a-4cd6-b75a-8eb1d78dc72b for instance 1d450d23-ad9c-43d6-a4dc-6e5c48e5292b on hv-cinder-85331 Sep 07 16:11:19.102194 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-ce3f1faa-09c7-4092-914a-72a9beccb2c8 req-f8e2ea56-29dc-4eb1-844e-f7f3a565543a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046116 Sep 07 16:11:19.102886 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 604/1228] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 16:11:19.109972 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-08de60f7-6f73-4b5f-8631-c1212090e5cc tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 1d450d23-ad9c-43d6-a4dc-6e5c48e5292b] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 16:11:19.205857 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-08de60f7-6f73-4b5f-8631-c1212090e5cc tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1d450d23-ad9c-43d6-a4dc-6e5c48e5292b" status: 204 len: 0 microversion: 2.1 time: 0.153842 Sep 07 16:11:19.206861 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 625/1229] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Sep 7 16:11:19 2022] DELETE /compute/v2.1/servers/1d450d23-ad9c-43d6-a4dc-6e5c48e5292b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 16:11:19.215818 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-2308c3bc-e6a4-4a3a-be90-339603d6011a tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:11:19.216665 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-2308c3bc-e6a4-4a3a-be90-339603d6011a tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 1d450d23-ad9c-43d6-a4dc-6e5c48e5292b] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:11:19.226050 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2308c3bc-e6a4-4a3a-be90-339603d6011a tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:19.226668 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2308c3bc-e6a4-4a3a-be90-339603d6011a tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:19.227363 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2308c3bc-e6a4-4a3a-be90-339603d6011a tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:19.229349 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2308c3bc-e6a4-4a3a-be90-339603d6011a tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:19.229931 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2308c3bc-e6a4-4a3a-be90-339603d6011a tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:19.230461 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-2308c3bc-e6a4-4a3a-be90-339603d6011a tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:19.365121 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-2308c3bc-e6a4-4a3a-be90-339603d6011a tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:11:19.378130 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-2308c3bc-e6a4-4a3a-be90-339603d6011a tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/1d450d23-ad9c-43d6-a4dc-6e5c48e5292b" status: 200 len: 1576 microversion: 2.1 time: 0.165912 Sep 07 16:11:19.379846 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 605/1230] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:11:19 2022] GET /compute/v2.1/servers/1d450d23-ad9c-43d6-a4dc-6e5c48e5292b => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:11:20.403498 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-3907b1d8-8be3-4e3f-89e1-c6864abb1f21 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:11:20.404332 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-3907b1d8-8be3-4e3f-89e1-c6864abb1f21 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 1d450d23-ad9c-43d6-a4dc-6e5c48e5292b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:11:20.410340 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3907b1d8-8be3-4e3f-89e1-c6864abb1f21 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:20.410900 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3907b1d8-8be3-4e3f-89e1-c6864abb1f21 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:20.411330 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3907b1d8-8be3-4e3f-89e1-c6864abb1f21 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:20.412034 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3907b1d8-8be3-4e3f-89e1-c6864abb1f21 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:20.412482 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3907b1d8-8be3-4e3f-89e1-c6864abb1f21 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:20.412900 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-3907b1d8-8be3-4e3f-89e1-c6864abb1f21 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:20.617272 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-3907b1d8-8be3-4e3f-89e1-c6864abb1f21 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd595f32b5f2d406b9d6ce62acec1456b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef2c5a9809b4bee95a171cf6dca4e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:11:20.624941 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-3907b1d8-8be3-4e3f-89e1-c6864abb1f21 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/1d450d23-ad9c-43d6-a4dc-6e5c48e5292b" status: 200 len: 1457 microversion: 2.1 time: 0.225599 Sep 07 16:11:20.625502 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 626/1231] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:11:20 2022] GET /compute/v2.1/servers/1d450d23-ad9c-43d6-a4dc-6e5c48e5292b => generated 1457 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:11:20.729136 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-c7a5db7d-6e02-4cf1-bfa2-be1a80b5a283 req-4fae9938-6018-4371-bb10-233d5532bbd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d450d23-ad9c-43d6-a4dc-6e5c48e5292b", "name": "network-vif-deleted", "tag": "bf299e5b-1f8a-4cd6-b75a-8eb1d78dc72b"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:11:20.742097 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-c7a5db7d-6e02-4cf1-bfa2-be1a80b5a283 req-4fae9938-6018-4371-bb10-233d5532bbd1 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:20.742567 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-c7a5db7d-6e02-4cf1-bfa2-be1a80b5a283 req-4fae9938-6018-4371-bb10-233d5532bbd1 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:20.742989 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-c7a5db7d-6e02-4cf1-bfa2-be1a80b5a283 req-4fae9938-6018-4371-bb10-233d5532bbd1 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:20.755895 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-c7a5db7d-6e02-4cf1-bfa2-be1a80b5a283 req-4fae9938-6018-4371-bb10-233d5532bbd1 service nova] Creating event network-vif-deleted:bf299e5b-1f8a-4cd6-b75a-8eb1d78dc72b for instance 1d450d23-ad9c-43d6-a4dc-6e5c48e5292b on hv-cinder-85331 Sep 07 16:11:20.762985 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-c7a5db7d-6e02-4cf1-bfa2-be1a80b5a283 req-4fae9938-6018-4371-bb10-233d5532bbd1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037017 Sep 07 16:11:20.763614 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 606/1232] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:11:21.649183 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-36fb6ae2-b0dd-4a7b-b489-ccca9dec44fe tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:11:21.649792 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-36fb6ae2-b0dd-4a7b-b489-ccca9dec44fe tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: 1d450d23-ad9c-43d6-a4dc-6e5c48e5292b] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:11:21.656361 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36fb6ae2-b0dd-4a7b-b489-ccca9dec44fe tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:21.656846 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36fb6ae2-b0dd-4a7b-b489-ccca9dec44fe tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:21.657276 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36fb6ae2-b0dd-4a7b-b489-ccca9dec44fe tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:21.657964 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36fb6ae2-b0dd-4a7b-b489-ccca9dec44fe tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:21.659073 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36fb6ae2-b0dd-4a7b-b489-ccca9dec44fe tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:21.659499 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-36fb6ae2-b0dd-4a7b-b489-ccca9dec44fe tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:21.672802 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-36fb6ae2-b0dd-4a7b-b489-ccca9dec44fe tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] HTTP exception thrown: Instance 1d450d23-ad9c-43d6-a4dc-6e5c48e5292b could not be found. Sep 07 16:11:21.674614 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-36fb6ae2-b0dd-4a7b-b489-ccca9dec44fe tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Request method failure captured: Sep 07 16:11:21.674614 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/1d450d23-ad9c-43d6-a4dc-6e5c48e5292b HTTP/1.1 Sep 07 16:11:21.674614 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept: application/json Sep 07 16:11:21.674614 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Sep 07 16:11:21.674614 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Connection: close Sep 07 16:11:21.674614 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Length: 0 Sep 07 16:11:21.674614 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Type: application/json Sep 07 16:11:21.674614 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Host: 10.222.0.17 Sep 07 16:11:21.674614 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Sep 07 16:11:21.674614 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Sep 07 16:11:21.674614 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjGMCaCWK5xf9_Qvk5IFgMfJDHID5TkXXoesVdgbHz0eEjX3zQJhIE6W6YFFA1AfRDMFZ9pjH-yhGyY7LOqC3Xi0awLaiFlAJwwC4L0zaoaV9ooyG1X0vA8TJJ6eSQzSsQMIz7yVkLc_Y3LHczdQ2YmI0aHfl5iA-Qj_Bve7Ps3248I00 Sep 07 16:11:21.674614 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Sep 07 16:11:21.674614 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Sep 07 16:11:21.674614 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Sep 07 16:11:21.674614 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Sep 07 16:11:21.674614 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Sep 07 16:11:21.674614 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Sep 07 16:11:21.674614 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Id: 6ef2c5a9809b4bee95a171cf6dca4e2b Sep 07 16:11:21.674614 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-TestVolumeBootPattern-1462709202 Sep 07 16:11:21.674614 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Role: reader,member Sep 07 16:11:21.674614 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Roles: reader,member Sep 07 16:11:21.676228 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6ef2c5a9809b4bee95a171cf6dca4e2b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6ef2c5a9809b4bee95a171cf6dca4e2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6ef2c5a9809b4bee95a171cf6dca4e2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6ef2c5a9809b4bee95a171cf6dca4e2b"}]}] Sep 07 16:11:21.676228 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-TestVolumeBootPattern-1462709202 Sep 07 16:11:21.676228 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Id: 6ef2c5a9809b4bee95a171cf6dca4e2b Sep 07 16:11:21.676228 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-TestVolumeBootPattern-1462709202 Sep 07 16:11:21.676228 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User: tempest-TestVolumeBootPattern-1462709202-project Sep 07 16:11:21.676228 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Sep 07 16:11:21.676228 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Sep 07 16:11:21.676228 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Id: d595f32b5f2d406b9d6ce62acec1456b Sep 07 16:11:21.676228 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-TestVolumeBootPattern-1462709202-project Sep 07 16:11:21.676228 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: method: > Sep 07 16:11:21.676228 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: exception: Instance 1d450d23-ad9c-43d6-a4dc-6e5c48e5292b could not be found. Sep 07 16:11:21.676228 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: action_args: {'id': '1d450d23-ad9c-43d6-a4dc-6e5c48e5292b'} Sep 07 16:11:21.681142 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 16:11:21.681142 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:11:21.681142 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 16:11:21.681142 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 16:11:21.681142 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 16:11:21.681142 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 16:11:21.681142 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 16:11:21.681142 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 16:11:21.681142 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 16:11:21.681142 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 16:11:21.681142 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d450d23-ad9c-43d6-a4dc-6e5c48e5292b could not be found. Sep 07 16:11:21.681142 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:11:21.681142 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:11:21.681142 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:11:21.681142 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:11:21.681142 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:11:21.681142 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:11:21.681142 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 16:11:21.681142 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 16:11:21.681142 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 16:11:21.683777 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 16:11:21.683777 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 16:11:21.683777 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 16:11:21.683777 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 16:11:21.683777 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 16:11:21.683777 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 16:11:21.683777 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 16:11:21.683777 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d450d23-ad9c-43d6-a4dc-6e5c48e5292b could not be found. Sep 07 16:11:21.683777 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:11:21.683777 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:11:21.683777 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:11:21.683777 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:11:21.683777 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:11:21.683777 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:11:21.683777 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 16:11:21.683777 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 16:11:21.683777 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d450d23-ad9c-43d6-a4dc-6e5c48e5292b could not be found. Sep 07 16:11:21.683777 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:11:21.685202 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-36fb6ae2-b0dd-4a7b-b489-ccca9dec44fe tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Returning 404 to user: Instance 1d450d23-ad9c-43d6-a4dc-6e5c48e5292b could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 16:11:21.685202 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-36fb6ae2-b0dd-4a7b-b489-ccca9dec44fe tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/1d450d23-ad9c-43d6-a4dc-6e5c48e5292b" status: 404 len: 111 microversion: 2.1 time: 0.030745 Sep 07 16:11:21.685202 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 627/1233] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:11:21 2022] GET /compute/v2.1/servers/1d450d23-ad9c-43d6-a4dc-6e5c48e5292b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 16:11:22.113445 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d0d2a555-1638-4c2e-be1e-f72314eed198 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:11:22.114028 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-d0d2a555-1638-4c2e-be1e-f72314eed198 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: c936130f-9f16-463d-952f-f9824ab824f4] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:11:22.120605 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d0d2a555-1638-4c2e-be1e-f72314eed198 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:22.121136 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d0d2a555-1638-4c2e-be1e-f72314eed198 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:22.121516 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d0d2a555-1638-4c2e-be1e-f72314eed198 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:22.122191 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d0d2a555-1638-4c2e-be1e-f72314eed198 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:22.122638 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d0d2a555-1638-4c2e-be1e-f72314eed198 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:22.123082 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-d0d2a555-1638-4c2e-be1e-f72314eed198 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:22.136567 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-d0d2a555-1638-4c2e-be1e-f72314eed198 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] HTTP exception thrown: Instance c936130f-9f16-463d-952f-f9824ab824f4 could not be found. Sep 07 16:11:22.138211 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d0d2a555-1638-4c2e-be1e-f72314eed198 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Request method failure captured: Sep 07 16:11:22.138211 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: request: DELETE /compute/v2.1/servers/c936130f-9f16-463d-952f-f9824ab824f4 HTTP/1.1 Sep 07 16:11:22.138211 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Accept: application/json Sep 07 16:11:22.138211 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Accept-Encoding: identity Sep 07 16:11:22.138211 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Connection: close Sep 07 16:11:22.138211 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Content-Length: 0 Sep 07 16:11:22.138211 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Content-Type: application/json Sep 07 16:11:22.138211 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Host: 10.222.0.17 Sep 07 16:11:22.138211 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Openstack-System-Scope: None Sep 07 16:11:22.138211 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Sep 07 16:11:22.138211 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjGMCaCWK5xf9_Qvk5IFgMfJDHID5TkXXoesVdgbHz0eEjX3zQJhIE6W6YFFA1AfRDMFZ9pjH-yhGyY7LOqC3Xi0awLaiFlAJwwC4L0zaoaV9ooyG1X0vA8TJJ6eSQzSsQMIz7yVkLc_Y3LHczdQ2YmI0aHfl5iA-Qj_Bve7Ps3248I00 Sep 07 16:11:22.138211 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Domain-Id: None Sep 07 16:11:22.138211 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Domain-Name: None Sep 07 16:11:22.138211 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Identity-Status: Confirmed Sep 07 16:11:22.138211 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Is-Admin-Project: True Sep 07 16:11:22.138211 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Domain-Id: default Sep 07 16:11:22.138211 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Domain-Name: Default Sep 07 16:11:22.138211 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Id: 6ef2c5a9809b4bee95a171cf6dca4e2b Sep 07 16:11:22.138211 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Name: tempest-TestVolumeBootPattern-1462709202 Sep 07 16:11:22.138211 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Role: reader,member Sep 07 16:11:22.138211 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Roles: reader,member Sep 07 16:11:22.139938 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6ef2c5a9809b4bee95a171cf6dca4e2b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6ef2c5a9809b4bee95a171cf6dca4e2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6ef2c5a9809b4bee95a171cf6dca4e2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6ef2c5a9809b4bee95a171cf6dca4e2b"}]}] Sep 07 16:11:22.139938 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant: tempest-TestVolumeBootPattern-1462709202 Sep 07 16:11:22.139938 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant-Id: 6ef2c5a9809b4bee95a171cf6dca4e2b Sep 07 16:11:22.139938 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant-Name: tempest-TestVolumeBootPattern-1462709202 Sep 07 16:11:22.139938 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User: tempest-TestVolumeBootPattern-1462709202-project Sep 07 16:11:22.139938 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Domain-Id: default Sep 07 16:11:22.139938 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Domain-Name: Default Sep 07 16:11:22.139938 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Id: d595f32b5f2d406b9d6ce62acec1456b Sep 07 16:11:22.139938 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Name: tempest-TestVolumeBootPattern-1462709202-project Sep 07 16:11:22.139938 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: method: > Sep 07 16:11:22.139938 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: exception: Instance c936130f-9f16-463d-952f-f9824ab824f4 could not be found. Sep 07 16:11:22.139938 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: action_args: {'id': 'c936130f-9f16-463d-952f-f9824ab824f4'} Sep 07 16:11:22.140926 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 16:11:22.140926 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:11:22.140926 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 16:11:22.140926 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 16:11:22.140926 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 16:11:22.140926 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 16:11:22.140926 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 16:11:22.140926 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 16:11:22.140926 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 16:11:22.140926 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 16:11:22.140926 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c936130f-9f16-463d-952f-f9824ab824f4 could not be found. Sep 07 16:11:22.140926 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:11:22.140926 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:11:22.140926 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:11:22.140926 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:11:22.140926 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:11:22.140926 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:11:22.140926 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 16:11:22.140926 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 16:11:22.140926 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 16:11:22.142553 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 16:11:22.142553 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 16:11:22.142553 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 16:11:22.142553 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 16:11:22.142553 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 16:11:22.142553 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 16:11:22.142553 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 16:11:22.142553 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 16:11:22.142553 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 16:11:22.142553 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c936130f-9f16-463d-952f-f9824ab824f4 could not be found. Sep 07 16:11:22.142553 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:11:22.142553 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:11:22.142553 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:11:22.142553 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:11:22.142553 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:11:22.142553 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:11:22.142553 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 16:11:22.142553 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 16:11:22.142553 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c936130f-9f16-463d-952f-f9824ab824f4 could not be found. Sep 07 16:11:22.142553 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:11:22.144856 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-d0d2a555-1638-4c2e-be1e-f72314eed198 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Returning 404 to user: Instance c936130f-9f16-463d-952f-f9824ab824f4 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 16:11:22.144856 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-d0d2a555-1638-4c2e-be1e-f72314eed198 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c936130f-9f16-463d-952f-f9824ab824f4" status: 404 len: 111 microversion: 2.1 time: 0.030353 Sep 07 16:11:22.144856 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 607/1234] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Sep 7 16:11:22 2022] DELETE /compute/v2.1/servers/c936130f-9f16-463d-952f-f9824ab824f4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 16:11:22.148589 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0302c6da-3554-4927-abd1-3985a8744768 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:11:22.149231 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-0302c6da-3554-4927-abd1-3985a8744768 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] [instance: c936130f-9f16-463d-952f-f9824ab824f4] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:11:22.155160 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0302c6da-3554-4927-abd1-3985a8744768 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:22.155669 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0302c6da-3554-4927-abd1-3985a8744768 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:22.156135 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0302c6da-3554-4927-abd1-3985a8744768 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:22.156825 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0302c6da-3554-4927-abd1-3985a8744768 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:22.157280 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0302c6da-3554-4927-abd1-3985a8744768 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:22.157726 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-0302c6da-3554-4927-abd1-3985a8744768 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:22.171032 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-0302c6da-3554-4927-abd1-3985a8744768 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] HTTP exception thrown: Instance c936130f-9f16-463d-952f-f9824ab824f4 could not be found. Sep 07 16:11:22.172573 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0302c6da-3554-4927-abd1-3985a8744768 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Request method failure captured: Sep 07 16:11:22.172573 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/c936130f-9f16-463d-952f-f9824ab824f4 HTTP/1.1 Sep 07 16:11:22.172573 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept: application/json Sep 07 16:11:22.172573 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Sep 07 16:11:22.172573 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Connection: close Sep 07 16:11:22.172573 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Length: 0 Sep 07 16:11:22.172573 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Type: application/json Sep 07 16:11:22.172573 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Host: 10.222.0.17 Sep 07 16:11:22.172573 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Sep 07 16:11:22.172573 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Sep 07 16:11:22.172573 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjGMCaCWK5xf9_Qvk5IFgMfJDHID5TkXXoesVdgbHz0eEjX3zQJhIE6W6YFFA1AfRDMFZ9pjH-yhGyY7LOqC3Xi0awLaiFlAJwwC4L0zaoaV9ooyG1X0vA8TJJ6eSQzSsQMIz7yVkLc_Y3LHczdQ2YmI0aHfl5iA-Qj_Bve7Ps3248I00 Sep 07 16:11:22.172573 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Sep 07 16:11:22.172573 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Sep 07 16:11:22.172573 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Sep 07 16:11:22.172573 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Sep 07 16:11:22.172573 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Sep 07 16:11:22.172573 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Sep 07 16:11:22.172573 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Id: 6ef2c5a9809b4bee95a171cf6dca4e2b Sep 07 16:11:22.172573 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-TestVolumeBootPattern-1462709202 Sep 07 16:11:22.172573 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Role: reader,member Sep 07 16:11:22.172573 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Roles: reader,member Sep 07 16:11:22.175497 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6ef2c5a9809b4bee95a171cf6dca4e2b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6ef2c5a9809b4bee95a171cf6dca4e2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6ef2c5a9809b4bee95a171cf6dca4e2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6ef2c5a9809b4bee95a171cf6dca4e2b"}]}] Sep 07 16:11:22.175497 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-TestVolumeBootPattern-1462709202 Sep 07 16:11:22.175497 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Id: 6ef2c5a9809b4bee95a171cf6dca4e2b Sep 07 16:11:22.175497 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-TestVolumeBootPattern-1462709202 Sep 07 16:11:22.175497 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User: tempest-TestVolumeBootPattern-1462709202-project Sep 07 16:11:22.175497 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Sep 07 16:11:22.175497 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Sep 07 16:11:22.175497 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Id: d595f32b5f2d406b9d6ce62acec1456b Sep 07 16:11:22.175497 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-TestVolumeBootPattern-1462709202-project Sep 07 16:11:22.175497 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: method: > Sep 07 16:11:22.175497 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: exception: Instance c936130f-9f16-463d-952f-f9824ab824f4 could not be found. Sep 07 16:11:22.175497 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: action_args: {'id': 'c936130f-9f16-463d-952f-f9824ab824f4'} Sep 07 16:11:22.176361 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 16:11:22.176361 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:11:22.176361 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 16:11:22.176361 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 16:11:22.176361 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 16:11:22.176361 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 16:11:22.176361 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 16:11:22.176361 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 16:11:22.176361 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 16:11:22.176361 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 16:11:22.176361 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c936130f-9f16-463d-952f-f9824ab824f4 could not be found. Sep 07 16:11:22.176361 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:11:22.176361 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:11:22.176361 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:11:22.176361 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:11:22.176361 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:11:22.176361 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:11:22.176361 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 16:11:22.176361 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 16:11:22.176361 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 16:11:22.177964 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 16:11:22.177964 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 16:11:22.177964 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 16:11:22.177964 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 16:11:22.177964 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 16:11:22.177964 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 16:11:22.177964 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 16:11:22.177964 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c936130f-9f16-463d-952f-f9824ab824f4 could not be found. Sep 07 16:11:22.177964 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:11:22.177964 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:11:22.177964 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:11:22.177964 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:11:22.177964 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:11:22.177964 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:11:22.177964 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 16:11:22.177964 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 16:11:22.177964 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c936130f-9f16-463d-952f-f9824ab824f4 could not be found. Sep 07 16:11:22.177964 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:11:22.179388 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-0302c6da-3554-4927-abd1-3985a8744768 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Returning 404 to user: Instance c936130f-9f16-463d-952f-f9824ab824f4 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 16:11:22.179388 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-0302c6da-3554-4927-abd1-3985a8744768 tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "GET /compute/v2.1/servers/c936130f-9f16-463d-952f-f9824ab824f4" status: 404 len: 111 microversion: 2.1 time: 0.029145 Sep 07 16:11:22.179388 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 628/1235] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:11:22 2022] GET /compute/v2.1/servers/c936130f-9f16-463d-952f-f9824ab824f4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 16:11:23.466779 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-b72a2e2b-4d37-4fda-a9fd-ff35099a4d8f tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] Calling method '.version_select at 0x7ff9a5971ee0>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:11:23.488794 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-b72a2e2b-4d37-4fda-a9fd-ff35099a4d8f tempest-TestVolumeBootPattern-1462709202 tempest-TestVolumeBootPattern-1462709202-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-415497108" status: 202 len: 0 microversion: 2.1 time: 0.025535 Sep 07 16:11:23.489515 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 608/1236] 10.222.0.17 () {58 vars in 1260 bytes} [Wed Sep 7 16:11:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-415497108 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 16:11:38.601693 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e7789212-ba15-4659-a0fe-f3e3f4d0c5f2 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:11:38.602247 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e7789212-ba15-4659-a0fe-f3e3f4d0c5f2 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:11:38.604811 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:38.605447 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:38.611247 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7789212-ba15-4659-a0fe-f3e3f4d0c5f2 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:38.612324 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7789212-ba15-4659-a0fe-f3e3f4d0c5f2 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:38.612760 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7789212-ba15-4659-a0fe-f3e3f4d0c5f2 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:38.613459 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7789212-ba15-4659-a0fe-f3e3f4d0c5f2 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:38.613907 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7789212-ba15-4659-a0fe-f3e3f4d0c5f2 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:38.614329 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e7789212-ba15-4659-a0fe-f3e3f4d0c5f2 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:38.641674 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.objects.instance [None req-e7789212-ba15-4659-a0fe-f3e3f4d0c5f2 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lazy-loading 'flavor' on Instance uuid d25048e4-93d0-458e-bbe5-ba0a380f4b0c {{(pid=120640) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 16:11:38.721328 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e7789212-ba15-4659-a0fe-f3e3f4d0c5f2 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "POST /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c/action" status: 202 len: 0 microversion: 2.1 time: 0.123260 Sep 07 16:11:38.722032 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 629/1237] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Sep 7 16:11:38 2022] POST /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 16:11:38.728380 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:38.730141 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:11:38.734877 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6ac14172-3d3a-43ef-a871-71e0a1e5d7fb tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:11:38.735880 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6ac14172-3d3a-43ef-a871-71e0a1e5d7fb tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:11:38.745095 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ac14172-3d3a-43ef-a871-71e0a1e5d7fb tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:38.745697 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ac14172-3d3a-43ef-a871-71e0a1e5d7fb tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:38.746293 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ac14172-3d3a-43ef-a871-71e0a1e5d7fb tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:38.747123 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ac14172-3d3a-43ef-a871-71e0a1e5d7fb tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:38.747906 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ac14172-3d3a-43ef-a871-71e0a1e5d7fb tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:38.748428 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6ac14172-3d3a-43ef-a871-71e0a1e5d7fb tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:38.881586 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-6ac14172-3d3a-43ef-a871-71e0a1e5d7fb tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aa615f2c7c4c6eaa694f551e38436a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266789e160554ec0a0a334304a0ad39d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:11:38.889234 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6ac14172-3d3a-43ef-a871-71e0a1e5d7fb tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 200 len: 1568 microversion: 2.1 time: 0.162570 Sep 07 16:11:38.889792 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 609/1238] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:11:38 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:11:39.913139 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-df21be9f-2fdc-485c-86d1-264517dd08b3 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:11:39.913826 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-df21be9f-2fdc-485c-86d1-264517dd08b3 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:11:39.919950 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df21be9f-2fdc-485c-86d1-264517dd08b3 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:39.920425 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df21be9f-2fdc-485c-86d1-264517dd08b3 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:39.920847 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df21be9f-2fdc-485c-86d1-264517dd08b3 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:39.921519 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df21be9f-2fdc-485c-86d1-264517dd08b3 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:39.921963 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df21be9f-2fdc-485c-86d1-264517dd08b3 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:39.922381 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-df21be9f-2fdc-485c-86d1-264517dd08b3 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:40.050412 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-df21be9f-2fdc-485c-86d1-264517dd08b3 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aa615f2c7c4c6eaa694f551e38436a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266789e160554ec0a0a334304a0ad39d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:11:40.057990 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-df21be9f-2fdc-485c-86d1-264517dd08b3 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 200 len: 1568 microversion: 2.1 time: 0.149565 Sep 07 16:11:40.058543 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 630/1239] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:11:39 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:11:41.081413 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8bf3a3a5-1899-4a1a-aa22-006f047d33fc tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:11:41.081961 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8bf3a3a5-1899-4a1a-aa22-006f047d33fc tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:11:41.088355 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8bf3a3a5-1899-4a1a-aa22-006f047d33fc tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:41.088834 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8bf3a3a5-1899-4a1a-aa22-006f047d33fc tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:41.089266 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8bf3a3a5-1899-4a1a-aa22-006f047d33fc tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:41.089948 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8bf3a3a5-1899-4a1a-aa22-006f047d33fc tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:41.090399 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8bf3a3a5-1899-4a1a-aa22-006f047d33fc tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:41.090820 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8bf3a3a5-1899-4a1a-aa22-006f047d33fc tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:41.223902 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-8bf3a3a5-1899-4a1a-aa22-006f047d33fc tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aa615f2c7c4c6eaa694f551e38436a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266789e160554ec0a0a334304a0ad39d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:11:41.231595 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8bf3a3a5-1899-4a1a-aa22-006f047d33fc tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 200 len: 1568 microversion: 2.1 time: 0.154191 Sep 07 16:11:41.232151 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 610/1240] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:11:41 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:11:42.253979 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6e2ae119-a124-49fc-90be-26a5c07aa3ea tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:11:42.254611 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6e2ae119-a124-49fc-90be-26a5c07aa3ea tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:11:42.260968 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e2ae119-a124-49fc-90be-26a5c07aa3ea tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:42.261438 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e2ae119-a124-49fc-90be-26a5c07aa3ea tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:42.261873 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e2ae119-a124-49fc-90be-26a5c07aa3ea tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:42.262541 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e2ae119-a124-49fc-90be-26a5c07aa3ea tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:42.262999 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e2ae119-a124-49fc-90be-26a5c07aa3ea tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:42.263397 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6e2ae119-a124-49fc-90be-26a5c07aa3ea tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:42.394154 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6e2ae119-a124-49fc-90be-26a5c07aa3ea tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aa615f2c7c4c6eaa694f551e38436a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266789e160554ec0a0a334304a0ad39d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:11:42.402107 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6e2ae119-a124-49fc-90be-26a5c07aa3ea tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 200 len: 1568 microversion: 2.1 time: 0.151936 Sep 07 16:11:42.402860 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 631/1241] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:11:42 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:11:43.425214 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3834f2e8-907c-41a5-abf9-7540fd3fad7b tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:11:43.425829 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3834f2e8-907c-41a5-abf9-7540fd3fad7b tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:11:43.432213 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3834f2e8-907c-41a5-abf9-7540fd3fad7b tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:43.432701 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3834f2e8-907c-41a5-abf9-7540fd3fad7b tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:43.433138 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3834f2e8-907c-41a5-abf9-7540fd3fad7b tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:43.433837 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3834f2e8-907c-41a5-abf9-7540fd3fad7b tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:43.434294 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3834f2e8-907c-41a5-abf9-7540fd3fad7b tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:43.434717 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3834f2e8-907c-41a5-abf9-7540fd3fad7b tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:43.561522 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-3834f2e8-907c-41a5-abf9-7540fd3fad7b tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aa615f2c7c4c6eaa694f551e38436a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266789e160554ec0a0a334304a0ad39d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:11:43.569615 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3834f2e8-907c-41a5-abf9-7540fd3fad7b tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 200 len: 1568 microversion: 2.1 time: 0.148329 Sep 07 16:11:43.570174 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 611/1242] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:11:43 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:11:44.594194 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f4a72d37-46ba-4c00-887c-f18247220cef tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:11:44.594828 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f4a72d37-46ba-4c00-887c-f18247220cef tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:11:44.601928 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4a72d37-46ba-4c00-887c-f18247220cef tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:44.602398 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4a72d37-46ba-4c00-887c-f18247220cef tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:44.602823 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4a72d37-46ba-4c00-887c-f18247220cef tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:44.603526 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4a72d37-46ba-4c00-887c-f18247220cef tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:44.603990 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4a72d37-46ba-4c00-887c-f18247220cef tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:44.604405 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f4a72d37-46ba-4c00-887c-f18247220cef tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:44.737442 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-f4a72d37-46ba-4c00-887c-f18247220cef tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aa615f2c7c4c6eaa694f551e38436a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266789e160554ec0a0a334304a0ad39d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:11:44.745060 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f4a72d37-46ba-4c00-887c-f18247220cef tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 200 len: 1568 microversion: 2.1 time: 0.154742 Sep 07 16:11:44.745618 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 632/1243] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:11:44 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:11:45.766975 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-58537862-5da9-4767-abb8-d8cbe8a764ff tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:11:45.768194 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-58537862-5da9-4767-abb8-d8cbe8a764ff tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:11:45.774497 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-58537862-5da9-4767-abb8-d8cbe8a764ff tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:45.774980 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-58537862-5da9-4767-abb8-d8cbe8a764ff tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:45.775411 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-58537862-5da9-4767-abb8-d8cbe8a764ff tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:45.776118 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-58537862-5da9-4767-abb8-d8cbe8a764ff tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:45.776566 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-58537862-5da9-4767-abb8-d8cbe8a764ff tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:45.776986 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-58537862-5da9-4767-abb8-d8cbe8a764ff tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:45.907238 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-58537862-5da9-4767-abb8-d8cbe8a764ff tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aa615f2c7c4c6eaa694f551e38436a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266789e160554ec0a0a334304a0ad39d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:11:45.914891 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-58537862-5da9-4767-abb8-d8cbe8a764ff tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 200 len: 1568 microversion: 2.1 time: 0.151843 Sep 07 16:11:45.915446 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 612/1244] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:11:45 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:11:46.937276 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-6b787836-b416-42cc-8946-2750ac8457ed tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:11:46.937881 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-6b787836-b416-42cc-8946-2750ac8457ed tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:11:46.943935 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b787836-b416-42cc-8946-2750ac8457ed tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:46.944406 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b787836-b416-42cc-8946-2750ac8457ed tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:46.944832 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b787836-b416-42cc-8946-2750ac8457ed tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:46.945506 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b787836-b416-42cc-8946-2750ac8457ed tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:46.945949 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b787836-b416-42cc-8946-2750ac8457ed tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:46.946366 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-6b787836-b416-42cc-8946-2750ac8457ed tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:47.077523 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-6b787836-b416-42cc-8946-2750ac8457ed tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aa615f2c7c4c6eaa694f551e38436a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266789e160554ec0a0a334304a0ad39d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:11:47.085628 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-6b787836-b416-42cc-8946-2750ac8457ed tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 200 len: 1568 microversion: 2.1 time: 0.152257 Sep 07 16:11:47.086186 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 633/1245] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:11:46 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:11:48.109130 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7c0fa7c5-c705-4c6a-a9f6-9c44c8717d53 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:11:48.109735 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7c0fa7c5-c705-4c6a-a9f6-9c44c8717d53 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:11:48.116200 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c0fa7c5-c705-4c6a-a9f6-9c44c8717d53 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:48.116666 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c0fa7c5-c705-4c6a-a9f6-9c44c8717d53 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:48.117101 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c0fa7c5-c705-4c6a-a9f6-9c44c8717d53 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:48.117794 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c0fa7c5-c705-4c6a-a9f6-9c44c8717d53 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:48.118250 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c0fa7c5-c705-4c6a-a9f6-9c44c8717d53 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:48.118673 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7c0fa7c5-c705-4c6a-a9f6-9c44c8717d53 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:48.247017 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-7c0fa7c5-c705-4c6a-a9f6-9c44c8717d53 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aa615f2c7c4c6eaa694f551e38436a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266789e160554ec0a0a334304a0ad39d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:11:48.254593 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7c0fa7c5-c705-4c6a-a9f6-9c44c8717d53 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 200 len: 1568 microversion: 2.1 time: 0.149339 Sep 07 16:11:48.255152 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 613/1246] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:11:48 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:11:49.278546 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-d0d52e9a-2457-4a54-bbcb-7a10de1d83c3 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:11:49.279279 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-d0d52e9a-2457-4a54-bbcb-7a10de1d83c3 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:11:49.286009 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0d52e9a-2457-4a54-bbcb-7a10de1d83c3 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:49.286498 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0d52e9a-2457-4a54-bbcb-7a10de1d83c3 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:49.287637 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0d52e9a-2457-4a54-bbcb-7a10de1d83c3 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:49.288336 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0d52e9a-2457-4a54-bbcb-7a10de1d83c3 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:49.288791 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0d52e9a-2457-4a54-bbcb-7a10de1d83c3 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:49.289269 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-d0d52e9a-2457-4a54-bbcb-7a10de1d83c3 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:49.493515 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-d0d52e9a-2457-4a54-bbcb-7a10de1d83c3 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aa615f2c7c4c6eaa694f551e38436a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266789e160554ec0a0a334304a0ad39d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:11:49.501301 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-d0d52e9a-2457-4a54-bbcb-7a10de1d83c3 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 200 len: 1568 microversion: 2.1 time: 0.226746 Sep 07 16:11:49.501858 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 634/1247] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:11:49 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 1568 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:11:50.525468 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9ea0be5f-dc75-4cd4-9958-c8179fce554d tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:11:50.526016 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9ea0be5f-dc75-4cd4-9958-c8179fce554d tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:11:50.532628 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9ea0be5f-dc75-4cd4-9958-c8179fce554d tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:50.533107 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9ea0be5f-dc75-4cd4-9958-c8179fce554d tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:50.533543 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9ea0be5f-dc75-4cd4-9958-c8179fce554d tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:50.534226 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9ea0be5f-dc75-4cd4-9958-c8179fce554d tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:50.534679 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9ea0be5f-dc75-4cd4-9958-c8179fce554d tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:50.535099 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9ea0be5f-dc75-4cd4-9958-c8179fce554d tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:50.663454 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-9ea0be5f-dc75-4cd4-9958-c8179fce554d tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aa615f2c7c4c6eaa694f551e38436a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266789e160554ec0a0a334304a0ad39d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:11:50.671105 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9ea0be5f-dc75-4cd4-9958-c8179fce554d tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 200 len: 1568 microversion: 2.1 time: 0.150146 Sep 07 16:11:50.671693 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 614/1248] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:11:50 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:11:51.694633 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-19ce8cb1-7665-43e7-9882-10a5929980ef tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:11:51.695196 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-19ce8cb1-7665-43e7-9882-10a5929980ef tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:11:51.701789 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19ce8cb1-7665-43e7-9882-10a5929980ef tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:51.702269 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19ce8cb1-7665-43e7-9882-10a5929980ef tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:51.702709 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19ce8cb1-7665-43e7-9882-10a5929980ef tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:51.703409 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19ce8cb1-7665-43e7-9882-10a5929980ef tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:51.703901 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19ce8cb1-7665-43e7-9882-10a5929980ef tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:51.704330 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19ce8cb1-7665-43e7-9882-10a5929980ef tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:51.837850 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-19ce8cb1-7665-43e7-9882-10a5929980ef tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aa615f2c7c4c6eaa694f551e38436a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266789e160554ec0a0a334304a0ad39d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:11:51.845972 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-19ce8cb1-7665-43e7-9882-10a5929980ef tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 200 len: 1568 microversion: 2.1 time: 0.156091 Sep 07 16:11:51.846524 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 635/1249] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:11:51 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:11:52.925742 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-3c37503f-a71a-48af-90e9-2d1a899a50f0 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:11:52.926348 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-3c37503f-a71a-48af-90e9-2d1a899a50f0 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:11:52.932875 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c37503f-a71a-48af-90e9-2d1a899a50f0 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:52.933352 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c37503f-a71a-48af-90e9-2d1a899a50f0 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:52.933786 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c37503f-a71a-48af-90e9-2d1a899a50f0 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:52.934463 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c37503f-a71a-48af-90e9-2d1a899a50f0 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:52.934909 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c37503f-a71a-48af-90e9-2d1a899a50f0 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:52.935326 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-3c37503f-a71a-48af-90e9-2d1a899a50f0 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:53.063903 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-3c37503f-a71a-48af-90e9-2d1a899a50f0 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aa615f2c7c4c6eaa694f551e38436a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266789e160554ec0a0a334304a0ad39d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:11:53.071631 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-3c37503f-a71a-48af-90e9-2d1a899a50f0 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 200 len: 1509 microversion: 2.1 time: 0.149687 Sep 07 16:11:53.072125 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 615/1250] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:11:52 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 1509 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:11:53.093676 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f18858f8-a1a6-4737-92cb-416c83e9e56e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:11:53.094274 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f18858f8-a1a6-4737-92cb-416c83e9e56e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:11:53.101538 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f18858f8-a1a6-4737-92cb-416c83e9e56e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:53.102017 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f18858f8-a1a6-4737-92cb-416c83e9e56e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:53.102453 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f18858f8-a1a6-4737-92cb-416c83e9e56e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:53.103140 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f18858f8-a1a6-4737-92cb-416c83e9e56e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:53.103641 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f18858f8-a1a6-4737-92cb-416c83e9e56e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:53.104072 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f18858f8-a1a6-4737-92cb-416c83e9e56e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:53.145142 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f18858f8-a1a6-4737-92cb-416c83e9e56e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120640) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 07 16:11:53.209465 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f18858f8-a1a6-4737-92cb-416c83e9e56e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [1481e59d-f6af-49de-846b-997686597eca] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 07 16:11:54.216821 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [None req-f18858f8-a1a6-4737-92cb-416c83e9e56e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [1481e59d-f6af-49de-846b-997686597eca] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 58690. Sep 07 16:11:54.219917 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f18858f8-a1a6-4737-92cb-416c83e9e56e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "POST /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c/action" status: 202 len: 0 microversion: 2.1 time: 1.130078 Sep 07 16:11:54.220827 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 636/1251] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Sep 7 16:11:53 2022] POST /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c/action => generated 0 bytes in 1132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 16:11:54.228701 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9b037d40-1095-48e7-b2e8-a6b4511b0be0 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:11:54.229393 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-9b037d40-1095-48e7-b2e8-a6b4511b0be0 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:11:54.236035 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9b037d40-1095-48e7-b2e8-a6b4511b0be0 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:54.236514 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9b037d40-1095-48e7-b2e8-a6b4511b0be0 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:54.236944 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9b037d40-1095-48e7-b2e8-a6b4511b0be0 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:54.237622 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9b037d40-1095-48e7-b2e8-a6b4511b0be0 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:54.238065 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9b037d40-1095-48e7-b2e8-a6b4511b0be0 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:54.238482 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-9b037d40-1095-48e7-b2e8-a6b4511b0be0 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:54.386315 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-9b037d40-1095-48e7-b2e8-a6b4511b0be0 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aa615f2c7c4c6eaa694f551e38436a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266789e160554ec0a0a334304a0ad39d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:11:54.394228 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9b037d40-1095-48e7-b2e8-a6b4511b0be0 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 200 len: 1517 microversion: 2.1 time: 0.169305 Sep 07 16:11:54.394786 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 616/1252] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:11:54 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 1517 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:11:54.933914 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-eefa1358-cfaa-46ec-b5fb-7da05fc9dad7 req-7926731b-d16e-49ee-8ce3-295988bc90f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d25048e4-93d0-458e-bbe5-ba0a380f4b0c", "name": "network-vif-unplugged", "status": "completed", "tag": "430afbde-c047-4cf7-8a6c-587bd546651c"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:11:54.944353 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-eefa1358-cfaa-46ec-b5fb-7da05fc9dad7 req-7926731b-d16e-49ee-8ce3-295988bc90f2 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:54.945125 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-eefa1358-cfaa-46ec-b5fb-7da05fc9dad7 req-7926731b-d16e-49ee-8ce3-295988bc90f2 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:54.945474 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-eefa1358-cfaa-46ec-b5fb-7da05fc9dad7 req-7926731b-d16e-49ee-8ce3-295988bc90f2 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:54.956044 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.compute.server_external_events [req-eefa1358-cfaa-46ec-b5fb-7da05fc9dad7 req-7926731b-d16e-49ee-8ce3-295988bc90f2 service nova] Unable to find a host for instance d25048e4-93d0-458e-bbe5-ba0a380f4b0c. Dropping event network-vif-unplugged {{(pid=120640) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 07 16:11:54.956932 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-eefa1358-cfaa-46ec-b5fb-7da05fc9dad7 req-7926731b-d16e-49ee-8ce3-295988bc90f2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027373 Sep 07 16:11:54.957664 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 637/1253] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 07 16:11:55.417784 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0b4aeb13-e87e-4141-9163-324085bb2c1c tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:11:55.418390 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0b4aeb13-e87e-4141-9163-324085bb2c1c tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:11:55.424704 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b4aeb13-e87e-4141-9163-324085bb2c1c tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:55.425187 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b4aeb13-e87e-4141-9163-324085bb2c1c tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:55.425612 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b4aeb13-e87e-4141-9163-324085bb2c1c tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:55.426287 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b4aeb13-e87e-4141-9163-324085bb2c1c tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:55.426729 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b4aeb13-e87e-4141-9163-324085bb2c1c tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:55.427144 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0b4aeb13-e87e-4141-9163-324085bb2c1c tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:55.556069 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-0b4aeb13-e87e-4141-9163-324085bb2c1c tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aa615f2c7c4c6eaa694f551e38436a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266789e160554ec0a0a334304a0ad39d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:11:55.564177 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0b4aeb13-e87e-4141-9163-324085bb2c1c tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 200 len: 1519 microversion: 2.1 time: 0.150555 Sep 07 16:11:55.564696 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 617/1254] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:11:55 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:11:56.588119 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4c600148-40e0-470c-9266-10716e299411 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:11:56.588729 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4c600148-40e0-470c-9266-10716e299411 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:11:56.595607 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c600148-40e0-470c-9266-10716e299411 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:56.596092 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c600148-40e0-470c-9266-10716e299411 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:56.596532 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c600148-40e0-470c-9266-10716e299411 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:56.597226 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c600148-40e0-470c-9266-10716e299411 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:56.597710 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c600148-40e0-470c-9266-10716e299411 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:56.598138 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4c600148-40e0-470c-9266-10716e299411 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:56.823338 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-4c600148-40e0-470c-9266-10716e299411 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aa615f2c7c4c6eaa694f551e38436a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266789e160554ec0a0a334304a0ad39d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:11:56.831075 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4c600148-40e0-470c-9266-10716e299411 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 200 len: 1575 microversion: 2.1 time: 0.247361 Sep 07 16:11:56.831656 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 638/1255] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:11:56 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 1575 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:11:57.855501 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-bffba439-d08a-4977-bc1e-527aadf7e3b3 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:11:57.856148 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-bffba439-d08a-4977-bc1e-527aadf7e3b3 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:11:57.862624 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bffba439-d08a-4977-bc1e-527aadf7e3b3 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:57.863091 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bffba439-d08a-4977-bc1e-527aadf7e3b3 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:57.863527 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bffba439-d08a-4977-bc1e-527aadf7e3b3 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:57.864233 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bffba439-d08a-4977-bc1e-527aadf7e3b3 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:57.865324 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bffba439-d08a-4977-bc1e-527aadf7e3b3 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:57.865751 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-bffba439-d08a-4977-bc1e-527aadf7e3b3 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:57.995665 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-bffba439-d08a-4977-bc1e-527aadf7e3b3 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aa615f2c7c4c6eaa694f551e38436a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266789e160554ec0a0a334304a0ad39d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:11:58.003341 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-bffba439-d08a-4977-bc1e-527aadf7e3b3 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 200 len: 1575 microversion: 2.1 time: 0.151731 Sep 07 16:11:58.003959 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 618/1256] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:11:57 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:11:59.027377 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-884c6f2e-2d1d-4b88-9a6c-ae9b38cb0d73 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:11:59.027377 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-884c6f2e-2d1d-4b88-9a6c-ae9b38cb0d73 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:11:59.033475 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-884c6f2e-2d1d-4b88-9a6c-ae9b38cb0d73 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:59.033942 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-884c6f2e-2d1d-4b88-9a6c-ae9b38cb0d73 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:59.034367 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-884c6f2e-2d1d-4b88-9a6c-ae9b38cb0d73 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:59.035041 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-884c6f2e-2d1d-4b88-9a6c-ae9b38cb0d73 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:11:59.035482 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-884c6f2e-2d1d-4b88-9a6c-ae9b38cb0d73 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:11:59.035918 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-884c6f2e-2d1d-4b88-9a6c-ae9b38cb0d73 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:11:59.175462 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-884c6f2e-2d1d-4b88-9a6c-ae9b38cb0d73 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aa615f2c7c4c6eaa694f551e38436a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266789e160554ec0a0a334304a0ad39d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:11:59.183690 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-884c6f2e-2d1d-4b88-9a6c-ae9b38cb0d73 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 200 len: 1575 microversion: 2.1 time: 0.161035 Sep 07 16:11:59.184243 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 639/1257] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:11:59 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:12:00.206162 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-7d3e2cde-6276-4c46-b4c2-a313bd704a6e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:12:00.206763 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-7d3e2cde-6276-4c46-b4c2-a313bd704a6e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:12:00.213745 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d3e2cde-6276-4c46-b4c2-a313bd704a6e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:00.214225 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d3e2cde-6276-4c46-b4c2-a313bd704a6e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:00.214654 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d3e2cde-6276-4c46-b4c2-a313bd704a6e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:00.215331 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d3e2cde-6276-4c46-b4c2-a313bd704a6e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:00.215801 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d3e2cde-6276-4c46-b4c2-a313bd704a6e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:00.216221 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-7d3e2cde-6276-4c46-b4c2-a313bd704a6e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:00.342158 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-7d3e2cde-6276-4c46-b4c2-a313bd704a6e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aa615f2c7c4c6eaa694f551e38436a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266789e160554ec0a0a334304a0ad39d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:12:00.350161 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-7d3e2cde-6276-4c46-b4c2-a313bd704a6e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 200 len: 1575 microversion: 2.1 time: 0.147842 Sep 07 16:12:00.350727 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 619/1258] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:12:00 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 1575 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:12:01.375157 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-864f3a9c-adaf-4ca1-bb62-c93628aae5a0 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:12:01.375801 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-864f3a9c-adaf-4ca1-bb62-c93628aae5a0 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:12:01.383023 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-864f3a9c-adaf-4ca1-bb62-c93628aae5a0 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:01.383701 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-864f3a9c-adaf-4ca1-bb62-c93628aae5a0 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:01.384463 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-864f3a9c-adaf-4ca1-bb62-c93628aae5a0 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:01.385471 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-864f3a9c-adaf-4ca1-bb62-c93628aae5a0 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:01.386280 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-864f3a9c-adaf-4ca1-bb62-c93628aae5a0 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:01.387002 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-864f3a9c-adaf-4ca1-bb62-c93628aae5a0 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:01.514511 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-864f3a9c-adaf-4ca1-bb62-c93628aae5a0 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aa615f2c7c4c6eaa694f551e38436a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266789e160554ec0a0a334304a0ad39d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:12:01.522659 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-864f3a9c-adaf-4ca1-bb62-c93628aae5a0 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 200 len: 1575 microversion: 2.1 time: 0.152633 Sep 07 16:12:01.523219 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 640/1259] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:12:01 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:12:02.545391 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-0807c647-18bb-41db-8872-7280820de260 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:12:02.545933 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-0807c647-18bb-41db-8872-7280820de260 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:12:02.552423 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0807c647-18bb-41db-8872-7280820de260 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:02.553407 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0807c647-18bb-41db-8872-7280820de260 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:02.553863 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0807c647-18bb-41db-8872-7280820de260 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:02.554540 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0807c647-18bb-41db-8872-7280820de260 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:02.554985 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0807c647-18bb-41db-8872-7280820de260 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:02.555399 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-0807c647-18bb-41db-8872-7280820de260 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:02.684261 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-0807c647-18bb-41db-8872-7280820de260 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aa615f2c7c4c6eaa694f551e38436a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266789e160554ec0a0a334304a0ad39d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:12:02.692068 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-0807c647-18bb-41db-8872-7280820de260 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 200 len: 1575 microversion: 2.1 time: 0.150458 Sep 07 16:12:02.692843 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 620/1260] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:12:02 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:12:03.716112 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-352b8506-1cbe-479f-9bd7-065d13be688e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:12:03.716758 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-352b8506-1cbe-479f-9bd7-065d13be688e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:12:03.723345 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-352b8506-1cbe-479f-9bd7-065d13be688e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:03.723853 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-352b8506-1cbe-479f-9bd7-065d13be688e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:03.724290 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-352b8506-1cbe-479f-9bd7-065d13be688e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:03.725479 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-352b8506-1cbe-479f-9bd7-065d13be688e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:03.725930 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-352b8506-1cbe-479f-9bd7-065d13be688e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:03.726351 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-352b8506-1cbe-479f-9bd7-065d13be688e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:03.851810 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-352b8506-1cbe-479f-9bd7-065d13be688e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aa615f2c7c4c6eaa694f551e38436a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266789e160554ec0a0a334304a0ad39d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:12:03.859478 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-352b8506-1cbe-479f-9bd7-065d13be688e tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 200 len: 1575 microversion: 2.1 time: 0.147455 Sep 07 16:12:03.860067 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 641/1261] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:12:03 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 1575 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:12:04.882202 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ed378fa0-2019-439a-a2a7-3b70629df7c8 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:12:04.882820 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ed378fa0-2019-439a-a2a7-3b70629df7c8 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:12:04.889287 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ed378fa0-2019-439a-a2a7-3b70629df7c8 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:04.889772 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ed378fa0-2019-439a-a2a7-3b70629df7c8 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:04.890209 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ed378fa0-2019-439a-a2a7-3b70629df7c8 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:04.890903 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ed378fa0-2019-439a-a2a7-3b70629df7c8 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:04.891360 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ed378fa0-2019-439a-a2a7-3b70629df7c8 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:04.891808 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ed378fa0-2019-439a-a2a7-3b70629df7c8 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:05.020417 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-ed378fa0-2019-439a-a2a7-3b70629df7c8 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aa615f2c7c4c6eaa694f551e38436a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266789e160554ec0a0a334304a0ad39d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:12:05.028698 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ed378fa0-2019-439a-a2a7-3b70629df7c8 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 200 len: 1575 microversion: 2.1 time: 0.150362 Sep 07 16:12:05.029276 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 621/1262] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:12:04 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:12:06.052556 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-e59e1df3-b43c-4e07-9c4f-5959fba67b97 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:12:06.053680 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-e59e1df3-b43c-4e07-9c4f-5959fba67b97 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:12:06.060128 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e59e1df3-b43c-4e07-9c4f-5959fba67b97 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:06.060605 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e59e1df3-b43c-4e07-9c4f-5959fba67b97 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:06.061033 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e59e1df3-b43c-4e07-9c4f-5959fba67b97 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:06.061709 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e59e1df3-b43c-4e07-9c4f-5959fba67b97 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:06.062154 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e59e1df3-b43c-4e07-9c4f-5959fba67b97 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:06.062570 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-e59e1df3-b43c-4e07-9c4f-5959fba67b97 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:06.194100 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-e59e1df3-b43c-4e07-9c4f-5959fba67b97 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aa615f2c7c4c6eaa694f551e38436a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266789e160554ec0a0a334304a0ad39d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:12:06.201758 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-e59e1df3-b43c-4e07-9c4f-5959fba67b97 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 200 len: 1575 microversion: 2.1 time: 0.153137 Sep 07 16:12:06.202318 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 642/1263] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:12:06 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:12:07.027826 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-07e6f8c6-48ed-429e-b3a5-3034a0bcc84f req-81955073-2b2d-4610-b0df-ff62bc6eaca9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d25048e4-93d0-458e-bbe5-ba0a380f4b0c", "name": "network-vif-plugged", "status": "completed", "tag": "430afbde-c047-4cf7-8a6c-587bd546651c"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:12:07.037572 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-07e6f8c6-48ed-429e-b3a5-3034a0bcc84f req-81955073-2b2d-4610-b0df-ff62bc6eaca9 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:07.038050 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-07e6f8c6-48ed-429e-b3a5-3034a0bcc84f req-81955073-2b2d-4610-b0df-ff62bc6eaca9 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:07.038483 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-07e6f8c6-48ed-429e-b3a5-3034a0bcc84f req-81955073-2b2d-4610-b0df-ff62bc6eaca9 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:07.050091 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-07e6f8c6-48ed-429e-b3a5-3034a0bcc84f req-81955073-2b2d-4610-b0df-ff62bc6eaca9 service nova] Creating event network-vif-plugged:430afbde-c047-4cf7-8a6c-587bd546651c for instance d25048e4-93d0-458e-bbe5-ba0a380f4b0c on hv-cinder-85331 Sep 07 16:12:07.055813 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-07e6f8c6-48ed-429e-b3a5-3034a0bcc84f req-81955073-2b2d-4610-b0df-ff62bc6eaca9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031582 Sep 07 16:12:07.056401 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 622/1264] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:12:07.225837 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4b56d782-9e56-49b8-8195-772a32d872fa tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:12:07.226442 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4b56d782-9e56-49b8-8195-772a32d872fa tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:12:07.232418 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b56d782-9e56-49b8-8195-772a32d872fa tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:07.232889 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b56d782-9e56-49b8-8195-772a32d872fa tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:07.233313 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b56d782-9e56-49b8-8195-772a32d872fa tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:07.233988 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b56d782-9e56-49b8-8195-772a32d872fa tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:07.234433 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b56d782-9e56-49b8-8195-772a32d872fa tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:07.235723 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4b56d782-9e56-49b8-8195-772a32d872fa tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:07.240608 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:07.432746 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-4b56d782-9e56-49b8-8195-772a32d872fa tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aa615f2c7c4c6eaa694f551e38436a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266789e160554ec0a0a334304a0ad39d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:12:07.442436 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4b56d782-9e56-49b8-8195-772a32d872fa tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 200 len: 1575 microversion: 2.1 time: 0.220824 Sep 07 16:12:07.443053 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 643/1265] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:12:07 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 1575 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:12:08.466921 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a89ffc48-4163-408d-92e7-d52517c9f0fb tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:12:08.467520 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a89ffc48-4163-408d-92e7-d52517c9f0fb tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:12:08.473861 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a89ffc48-4163-408d-92e7-d52517c9f0fb tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:08.474333 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a89ffc48-4163-408d-92e7-d52517c9f0fb tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:08.474787 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a89ffc48-4163-408d-92e7-d52517c9f0fb tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:08.475459 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a89ffc48-4163-408d-92e7-d52517c9f0fb tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:08.475929 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a89ffc48-4163-408d-92e7-d52517c9f0fb tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:08.476346 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a89ffc48-4163-408d-92e7-d52517c9f0fb tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:08.604822 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-a89ffc48-4163-408d-92e7-d52517c9f0fb tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aa615f2c7c4c6eaa694f551e38436a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266789e160554ec0a0a334304a0ad39d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:12:08.612601 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a89ffc48-4163-408d-92e7-d52517c9f0fb tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 200 len: 1575 microversion: 2.1 time: 0.150432 Sep 07 16:12:08.613161 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 623/1266] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:12:08 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:12:09.636082 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c50eed94-ec4c-43fa-975b-ecaad526afbc tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:12:09.636625 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c50eed94-ec4c-43fa-975b-ecaad526afbc tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:12:09.638878 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:09.644288 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c50eed94-ec4c-43fa-975b-ecaad526afbc tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:09.644756 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c50eed94-ec4c-43fa-975b-ecaad526afbc tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:09.645184 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c50eed94-ec4c-43fa-975b-ecaad526afbc tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:09.645859 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c50eed94-ec4c-43fa-975b-ecaad526afbc tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:09.646337 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c50eed94-ec4c-43fa-975b-ecaad526afbc tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:09.646755 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c50eed94-ec4c-43fa-975b-ecaad526afbc tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:09.774523 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-c50eed94-ec4c-43fa-975b-ecaad526afbc tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aa615f2c7c4c6eaa694f551e38436a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266789e160554ec0a0a334304a0ad39d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:12:09.782205 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c50eed94-ec4c-43fa-975b-ecaad526afbc tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 200 len: 1562 microversion: 2.1 time: 0.150070 Sep 07 16:12:09.782760 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 644/1267] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:12:09 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:12:19.415882 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-a5cbc818-bd11-41aa-a374-a47d018f39f6 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:12:19.416503 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-a5cbc818-bd11-41aa-a374-a47d018f39f6 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 039917c5-d07d-48cc-8a1e-14b973a93bb9] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:12:19.419428 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=30 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:19.420227 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=86 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:19.426309 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5cbc818-bd11-41aa-a374-a47d018f39f6 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:19.426788 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5cbc818-bd11-41aa-a374-a47d018f39f6 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:19.427232 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5cbc818-bd11-41aa-a374-a47d018f39f6 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:19.427957 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5cbc818-bd11-41aa-a374-a47d018f39f6 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:19.428408 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5cbc818-bd11-41aa-a374-a47d018f39f6 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:19.428834 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-a5cbc818-bd11-41aa-a374-a47d018f39f6 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:19.451956 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-a5cbc818-bd11-41aa-a374-a47d018f39f6 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/039917c5-d07d-48cc-8a1e-14b973a93bb9/ips" status: 200 len: 151 microversion: 2.1 time: 0.040031 Sep 07 16:12:19.452517 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 624/1268] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Sep 7 16:12:19 2022] GET /compute/v2.1/servers/039917c5-d07d-48cc-8a1e-14b973a93bb9/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:12:20.779595 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-4934a492-ff60-46ae-a449-b94ca83784aa tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2bf2f4d1-069c-4e71-8411-dbff3ff4e86e"}} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:12:20.782008 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-4934a492-ff60-46ae-a449-b94ca83784aa tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 039917c5-d07d-48cc-8a1e-14b973a93bb9] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:12:20.784669 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:20.785316 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=10 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:12:20.791995 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4934a492-ff60-46ae-a449-b94ca83784aa tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:20.792473 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4934a492-ff60-46ae-a449-b94ca83784aa tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:20.792913 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4934a492-ff60-46ae-a449-b94ca83784aa tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:20.793597 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4934a492-ff60-46ae-a449-b94ca83784aa tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:20.794051 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4934a492-ff60-46ae-a449-b94ca83784aa tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:20.794470 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-4934a492-ff60-46ae-a449-b94ca83784aa tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:21.059141 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-4934a492-ff60-46ae-a449-b94ca83784aa tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "POST /compute/v2.1/servers/039917c5-d07d-48cc-8a1e-14b973a93bb9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283487 Sep 07 16:12:21.059834 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 645/1269] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Sep 7 16:12:20 2022] POST /compute/v2.1/servers/039917c5-d07d-48cc-8a1e-14b973a93bb9/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:12:28.688178 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f3514651-3bfa-497e-bdda-970772b1198a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:12:28.688685 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f3514651-3bfa-497e-bdda-970772b1198a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 039917c5-d07d-48cc-8a1e-14b973a93bb9] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:12:28.696210 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f3514651-3bfa-497e-bdda-970772b1198a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:28.696852 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f3514651-3bfa-497e-bdda-970772b1198a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:28.697564 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f3514651-3bfa-497e-bdda-970772b1198a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:28.698357 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f3514651-3bfa-497e-bdda-970772b1198a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:28.698980 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f3514651-3bfa-497e-bdda-970772b1198a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:28.699682 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f3514651-3bfa-497e-bdda-970772b1198a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:28.778474 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-f3514651-3bfa-497e-bdda-970772b1198a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lazy-loading 'services' on Instance uuid 039917c5-d07d-48cc-8a1e-14b973a93bb9 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 16:12:28.847297 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f3514651-3bfa-497e-bdda-970772b1198a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "DELETE /compute/v2.1/servers/039917c5-d07d-48cc-8a1e-14b973a93bb9/os-volume_attachments/2bf2f4d1-069c-4e71-8411-dbff3ff4e86e" status: 202 len: 0 microversion: 2.1 time: 0.162882 Sep 07 16:12:28.848064 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 625/1270] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Sep 7 16:12:28 2022] DELETE /compute/v2.1/servers/039917c5-d07d-48cc-8a1e-14b973a93bb9/os-volume_attachments/2bf2f4d1-069c-4e71-8411-dbff3ff4e86e => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 16:12:28.857411 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-f3a3e46e-31de-465e-aad3-bd761f39f2e6 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:12:28.859764 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-f3a3e46e-31de-465e-aad3-bd761f39f2e6 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 039917c5-d07d-48cc-8a1e-14b973a93bb9] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:12:28.866541 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3a3e46e-31de-465e-aad3-bd761f39f2e6 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:28.867075 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3a3e46e-31de-465e-aad3-bd761f39f2e6 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:28.867506 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3a3e46e-31de-465e-aad3-bd761f39f2e6 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:28.868221 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3a3e46e-31de-465e-aad3-bd761f39f2e6 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:28.868666 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3a3e46e-31de-465e-aad3-bd761f39f2e6 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:28.869082 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-f3a3e46e-31de-465e-aad3-bd761f39f2e6 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:28.901021 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-f3a3e46e-31de-465e-aad3-bd761f39f2e6 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/039917c5-d07d-48cc-8a1e-14b973a93bb9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048378 Sep 07 16:12:28.901564 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 646/1271] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Sep 7 16:12:28 2022] GET /compute/v2.1/servers/039917c5-d07d-48cc-8a1e-14b973a93bb9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:12:29.915066 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-6959de96-5b0e-46b3-9747-bb54182f52bb tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:12:29.917416 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-6959de96-5b0e-46b3-9747-bb54182f52bb tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 039917c5-d07d-48cc-8a1e-14b973a93bb9] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:12:29.923528 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6959de96-5b0e-46b3-9747-bb54182f52bb tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:29.924040 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6959de96-5b0e-46b3-9747-bb54182f52bb tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:29.924479 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6959de96-5b0e-46b3-9747-bb54182f52bb tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:29.925161 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6959de96-5b0e-46b3-9747-bb54182f52bb tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:29.925615 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6959de96-5b0e-46b3-9747-bb54182f52bb tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:29.926043 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-6959de96-5b0e-46b3-9747-bb54182f52bb tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:29.954562 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-6959de96-5b0e-46b3-9747-bb54182f52bb tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/039917c5-d07d-48cc-8a1e-14b973a93bb9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044389 Sep 07 16:12:29.955102 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 626/1272] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Sep 7 16:12:29 2022] GET /compute/v2.1/servers/039917c5-d07d-48cc-8a1e-14b973a93bb9/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 16:12:30.019770 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-c6c5146e-3198-41d5-a771-d2aff8a9421b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:12:30.020348 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c6c5146e-3198-41d5-a771-d2aff8a9421b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 039917c5-d07d-48cc-8a1e-14b973a93bb9] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:12:30.027102 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6c5146e-3198-41d5-a771-d2aff8a9421b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:30.027597 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6c5146e-3198-41d5-a771-d2aff8a9421b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:30.028036 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6c5146e-3198-41d5-a771-d2aff8a9421b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:30.028711 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6c5146e-3198-41d5-a771-d2aff8a9421b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:30.029154 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6c5146e-3198-41d5-a771-d2aff8a9421b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:30.029571 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-c6c5146e-3198-41d5-a771-d2aff8a9421b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:30.053524 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-c6c5146e-3198-41d5-a771-d2aff8a9421b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 039917c5-d07d-48cc-8a1e-14b973a93bb9] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 16:12:30.127508 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-c6c5146e-3198-41d5-a771-d2aff8a9421b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "DELETE /compute/v2.1/servers/039917c5-d07d-48cc-8a1e-14b973a93bb9" status: 204 len: 0 microversion: 2.1 time: 0.111102 Sep 07 16:12:30.128516 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 647/1273] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Sep 7 16:12:30 2022] DELETE /compute/v2.1/servers/039917c5-d07d-48cc-8a1e-14b973a93bb9 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 16:12:30.137253 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-e9ef68ca-462c-4b2a-b308-d4e45b476da0 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:12:30.137887 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-e9ef68ca-462c-4b2a-b308-d4e45b476da0 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 039917c5-d07d-48cc-8a1e-14b973a93bb9] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:12:30.143739 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e9ef68ca-462c-4b2a-b308-d4e45b476da0 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:30.144220 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e9ef68ca-462c-4b2a-b308-d4e45b476da0 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:30.144656 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e9ef68ca-462c-4b2a-b308-d4e45b476da0 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:30.145332 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e9ef68ca-462c-4b2a-b308-d4e45b476da0 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:30.145784 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e9ef68ca-462c-4b2a-b308-d4e45b476da0 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:30.146205 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-e9ef68ca-462c-4b2a-b308-d4e45b476da0 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:30.277796 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-e9ef68ca-462c-4b2a-b308-d4e45b476da0 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:12:30.285502 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-e9ef68ca-462c-4b2a-b308-d4e45b476da0 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/039917c5-d07d-48cc-8a1e-14b973a93bb9" status: 200 len: 1683 microversion: 2.1 time: 0.152012 Sep 07 16:12:30.286061 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 627/1274] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:12:30 2022] GET /compute/v2.1/servers/039917c5-d07d-48cc-8a1e-14b973a93bb9 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:12:31.309067 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-19fbcc8d-9688-4a25-be2b-06d9a88b1b5e tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:12:31.309771 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-19fbcc8d-9688-4a25-be2b-06d9a88b1b5e tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 039917c5-d07d-48cc-8a1e-14b973a93bb9] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:12:31.316372 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19fbcc8d-9688-4a25-be2b-06d9a88b1b5e tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:31.316852 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19fbcc8d-9688-4a25-be2b-06d9a88b1b5e tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:31.317288 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19fbcc8d-9688-4a25-be2b-06d9a88b1b5e tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:31.317979 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19fbcc8d-9688-4a25-be2b-06d9a88b1b5e tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:31.318427 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19fbcc8d-9688-4a25-be2b-06d9a88b1b5e tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:31.318852 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-19fbcc8d-9688-4a25-be2b-06d9a88b1b5e tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:31.450417 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-19fbcc8d-9688-4a25-be2b-06d9a88b1b5e tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:12:31.457988 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-19fbcc8d-9688-4a25-be2b-06d9a88b1b5e tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/039917c5-d07d-48cc-8a1e-14b973a93bb9" status: 200 len: 1683 microversion: 2.1 time: 0.153172 Sep 07 16:12:31.458541 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 648/1275] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:12:31 2022] GET /compute/v2.1/servers/039917c5-d07d-48cc-8a1e-14b973a93bb9 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:12:32.482265 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-953dc62c-aefd-43cf-b66f-596ce60187cc tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:12:32.482866 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-953dc62c-aefd-43cf-b66f-596ce60187cc tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 039917c5-d07d-48cc-8a1e-14b973a93bb9] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:12:32.489290 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-953dc62c-aefd-43cf-b66f-596ce60187cc tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:32.489764 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-953dc62c-aefd-43cf-b66f-596ce60187cc tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:32.490192 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-953dc62c-aefd-43cf-b66f-596ce60187cc tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:32.490872 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-953dc62c-aefd-43cf-b66f-596ce60187cc tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:32.491318 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-953dc62c-aefd-43cf-b66f-596ce60187cc tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:32.491761 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-953dc62c-aefd-43cf-b66f-596ce60187cc tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:32.619820 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-953dc62c-aefd-43cf-b66f-596ce60187cc tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:12:32.627469 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-953dc62c-aefd-43cf-b66f-596ce60187cc tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/039917c5-d07d-48cc-8a1e-14b973a93bb9" status: 200 len: 1683 microversion: 2.1 time: 0.149043 Sep 07 16:12:32.628068 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 628/1276] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:12:32 2022] GET /compute/v2.1/servers/039917c5-d07d-48cc-8a1e-14b973a93bb9 => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:12:33.055361 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [req-20ccb4b7-c4ca-491b-a4c6-3a984da6b7be req-33fead89-d05f-48b6-9d97-1a72f087f9e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "039917c5-d07d-48cc-8a1e-14b973a93bb9", "name": "network-vif-deleted", "tag": "f935c961-dcc5-4306-81b5-00a57795c87a"}]} {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:12:33.071035 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-20ccb4b7-c4ca-491b-a4c6-3a984da6b7be req-33fead89-d05f-48b6-9d97-1a72f087f9e1 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:33.071503 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-20ccb4b7-c4ca-491b-a4c6-3a984da6b7be req-33fead89-d05f-48b6-9d97-1a72f087f9e1 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:33.071959 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [req-20ccb4b7-c4ca-491b-a4c6-3a984da6b7be req-33fead89-d05f-48b6-9d97-1a72f087f9e1 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:33.096311 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.compute.server_external_events [req-20ccb4b7-c4ca-491b-a4c6-3a984da6b7be req-33fead89-d05f-48b6-9d97-1a72f087f9e1 service nova] Creating event network-vif-deleted:f935c961-dcc5-4306-81b5-00a57795c87a for instance 039917c5-d07d-48cc-8a1e-14b973a93bb9 on hv-cinder-85331 Sep 07 16:12:33.101874 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [req-20ccb4b7-c4ca-491b-a4c6-3a984da6b7be req-33fead89-d05f-48b6-9d97-1a72f087f9e1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050524 Sep 07 16:12:33.102870 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 649/1277] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:12:33.650471 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-20cf68dd-89ff-4e18-993b-fe4d5f0b8ce9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:12:33.651168 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-20cf68dd-89ff-4e18-993b-fe4d5f0b8ce9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 039917c5-d07d-48cc-8a1e-14b973a93bb9] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:12:33.661263 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-20cf68dd-89ff-4e18-993b-fe4d5f0b8ce9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:33.661929 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-20cf68dd-89ff-4e18-993b-fe4d5f0b8ce9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:33.663349 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-20cf68dd-89ff-4e18-993b-fe4d5f0b8ce9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:33.674472 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-20cf68dd-89ff-4e18-993b-fe4d5f0b8ce9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:33.676149 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-20cf68dd-89ff-4e18-993b-fe4d5f0b8ce9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:33.677867 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-20cf68dd-89ff-4e18-993b-fe4d5f0b8ce9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:33.716682 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-20cf68dd-89ff-4e18-993b-fe4d5f0b8ce9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:33.717158 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-20cf68dd-89ff-4e18-993b-fe4d5f0b8ce9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:33.717633 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-20cf68dd-89ff-4e18-993b-fe4d5f0b8ce9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:33.718083 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.objects.instance [None req-20cf68dd-89ff-4e18-993b-fe4d5f0b8ce9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lazy-loading 'fault' on Instance uuid 039917c5-d07d-48cc-8a1e-14b973a93bb9 {{(pid=120641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 16:12:33.760754 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-20cf68dd-89ff-4e18-993b-fe4d5f0b8ce9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dab44e593194fe788216b029eecd10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1963a1a6684af58f5c240787788b60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:12:33.767590 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-20cf68dd-89ff-4e18-993b-fe4d5f0b8ce9 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/039917c5-d07d-48cc-8a1e-14b973a93bb9" status: 200 len: 1332 microversion: 2.1 time: 0.121280 Sep 07 16:12:33.768877 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 629/1278] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:12:33 2022] GET /compute/v2.1/servers/039917c5-d07d-48cc-8a1e-14b973a93bb9 => generated 1332 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:12:34.792478 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8e1d3401-40e1-473a-8d4a-82f9498a342f tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:12:34.793182 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-8e1d3401-40e1-473a-8d4a-82f9498a342f tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 039917c5-d07d-48cc-8a1e-14b973a93bb9] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:12:34.799786 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8e1d3401-40e1-473a-8d4a-82f9498a342f tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:34.800265 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8e1d3401-40e1-473a-8d4a-82f9498a342f tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:34.800700 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8e1d3401-40e1-473a-8d4a-82f9498a342f tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:34.801392 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8e1d3401-40e1-473a-8d4a-82f9498a342f tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:34.801848 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8e1d3401-40e1-473a-8d4a-82f9498a342f tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:34.802275 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-8e1d3401-40e1-473a-8d4a-82f9498a342f tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:34.821257 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-8e1d3401-40e1-473a-8d4a-82f9498a342f tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] HTTP exception thrown: Instance 039917c5-d07d-48cc-8a1e-14b973a93bb9 could not be found. Sep 07 16:12:34.822863 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8e1d3401-40e1-473a-8d4a-82f9498a342f tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Request method failure captured: Sep 07 16:12:34.822863 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: request: GET /compute/v2.1/servers/039917c5-d07d-48cc-8a1e-14b973a93bb9 HTTP/1.1 Sep 07 16:12:34.822863 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept: application/json Sep 07 16:12:34.822863 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Sep 07 16:12:34.822863 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Connection: close Sep 07 16:12:34.822863 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Length: 0 Sep 07 16:12:34.822863 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Type: application/json Sep 07 16:12:34.822863 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Host: 10.222.0.17 Sep 07 16:12:34.822863 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Sep 07 16:12:34.822863 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Sep 07 16:12:34.822863 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjGMEEfdw4OUg2B39RKswOmT5z54ISjPs9Ys-pBh0gUFq_XPVQCzkiphko1MTfezgc9xGOiE9M4-fp-aoq8efmnODenpErT0vQYyVQWrBzaRRoo-wl5i6l7H-bvKljvP6w5U1cAwX2okeVPnYRC9X59Bw9YuV07_v6iRyvOmKt9QO33DU Sep 07 16:12:34.822863 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Sep 07 16:12:34.822863 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Sep 07 16:12:34.822863 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Sep 07 16:12:34.822863 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Sep 07 16:12:34.822863 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Sep 07 16:12:34.822863 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Sep 07 16:12:34.822863 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Id: ab1963a1a6684af58f5c240787788b60 Sep 07 16:12:34.822863 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-AttachVolumeNegativeTest-857872657 Sep 07 16:12:34.822863 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Role: reader,member Sep 07 16:12:34.822863 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Roles: reader,member Sep 07 16:12:34.824706 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ab1963a1a6684af58f5c240787788b60", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ab1963a1a6684af58f5c240787788b60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ab1963a1a6684af58f5c240787788b60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ab1963a1a6684af58f5c240787788b60"}]}] Sep 07 16:12:34.824706 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-AttachVolumeNegativeTest-857872657 Sep 07 16:12:34.824706 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Id: ab1963a1a6684af58f5c240787788b60 Sep 07 16:12:34.824706 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-857872657 Sep 07 16:12:34.824706 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User: tempest-AttachVolumeNegativeTest-857872657-project Sep 07 16:12:34.824706 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Sep 07 16:12:34.824706 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Sep 07 16:12:34.824706 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Id: 2dab44e593194fe788216b029eecd10c Sep 07 16:12:34.824706 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-AttachVolumeNegativeTest-857872657-project Sep 07 16:12:34.824706 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: method: > Sep 07 16:12:34.824706 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: exception: Instance 039917c5-d07d-48cc-8a1e-14b973a93bb9 could not be found. Sep 07 16:12:34.824706 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: action_args: {'id': '039917c5-d07d-48cc-8a1e-14b973a93bb9'} Sep 07 16:12:34.825814 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 16:12:34.825814 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:12:34.825814 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 16:12:34.825814 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 16:12:34.825814 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 16:12:34.825814 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 16:12:34.825814 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 16:12:34.825814 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 16:12:34.825814 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 16:12:34.825814 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 16:12:34.825814 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 039917c5-d07d-48cc-8a1e-14b973a93bb9 could not be found. Sep 07 16:12:34.825814 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:12:34.825814 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:12:34.825814 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:12:34.825814 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:12:34.825814 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:12:34.825814 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:12:34.825814 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 16:12:34.825814 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 16:12:34.825814 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 16:12:34.827469 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 16:12:34.827469 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 16:12:34.827469 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 16:12:34.827469 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 16:12:34.827469 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 16:12:34.827469 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 16:12:34.827469 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 16:12:34.827469 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 039917c5-d07d-48cc-8a1e-14b973a93bb9 could not be found. Sep 07 16:12:34.827469 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:12:34.827469 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:12:34.827469 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:12:34.827469 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:12:34.827469 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:12:34.827469 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:12:34.827469 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 16:12:34.827469 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 16:12:34.827469 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 039917c5-d07d-48cc-8a1e-14b973a93bb9 could not be found. Sep 07 16:12:34.827469 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:12:34.829135 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-8e1d3401-40e1-473a-8d4a-82f9498a342f tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Returning 404 to user: Instance 039917c5-d07d-48cc-8a1e-14b973a93bb9 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 16:12:34.829135 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-8e1d3401-40e1-473a-8d4a-82f9498a342f tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/039917c5-d07d-48cc-8a1e-14b973a93bb9" status: 404 len: 111 microversion: 2.1 time: 0.036054 Sep 07 16:12:34.829135 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 650/1279] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:12:34 2022] GET /compute/v2.1/servers/039917c5-d07d-48cc-8a1e-14b973a93bb9 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 16:12:34.833245 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-9e5f5095-6575-4674-a750-544867d1c2d6 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '.version_select at 0x7ff9a5945e50>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:12:34.851670 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-9e5f5095-6575-4674-a750-544867d1c2d6 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1913017142" status: 202 len: 0 microversion: 2.1 time: 0.022198 Sep 07 16:12:34.852223 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 630/1280] 10.222.0.17 () {58 vars in 1221 bytes} [Wed Sep 7 16:12:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1913017142 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 16:12:36.574006 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-86ccda3e-9873-44b2-a1af-862cbf65a371 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:12:36.574505 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-86ccda3e-9873-44b2-a1af-862cbf65a371 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 039917c5-d07d-48cc-8a1e-14b973a93bb9] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:12:36.580695 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86ccda3e-9873-44b2-a1af-862cbf65a371 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:36.581165 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86ccda3e-9873-44b2-a1af-862cbf65a371 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:36.581591 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86ccda3e-9873-44b2-a1af-862cbf65a371 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:36.582260 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86ccda3e-9873-44b2-a1af-862cbf65a371 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:36.582702 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86ccda3e-9873-44b2-a1af-862cbf65a371 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:36.583118 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-86ccda3e-9873-44b2-a1af-862cbf65a371 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:36.596377 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-86ccda3e-9873-44b2-a1af-862cbf65a371 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] HTTP exception thrown: Instance 039917c5-d07d-48cc-8a1e-14b973a93bb9 could not be found. Sep 07 16:12:36.597896 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-86ccda3e-9873-44b2-a1af-862cbf65a371 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Request method failure captured: Sep 07 16:12:36.597896 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: request: DELETE /compute/v2.1/servers/039917c5-d07d-48cc-8a1e-14b973a93bb9 HTTP/1.1 Sep 07 16:12:36.597896 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept: application/json Sep 07 16:12:36.597896 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Sep 07 16:12:36.597896 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Connection: close Sep 07 16:12:36.597896 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Length: 0 Sep 07 16:12:36.597896 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Type: application/json Sep 07 16:12:36.597896 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Host: 10.222.0.17 Sep 07 16:12:36.597896 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Sep 07 16:12:36.597896 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Sep 07 16:12:36.597896 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjGMEEfdw4OUg2B39RKswOmT5z54ISjPs9Ys-pBh0gUFq_XPVQCzkiphko1MTfezgc9xGOiE9M4-fp-aoq8efmnODenpErT0vQYyVQWrBzaRRoo-wl5i6l7H-bvKljvP6w5U1cAwX2okeVPnYRC9X59Bw9YuV07_v6iRyvOmKt9QO33DU Sep 07 16:12:36.597896 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Sep 07 16:12:36.597896 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Sep 07 16:12:36.597896 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Sep 07 16:12:36.597896 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Sep 07 16:12:36.597896 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Sep 07 16:12:36.597896 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Sep 07 16:12:36.597896 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Id: ab1963a1a6684af58f5c240787788b60 Sep 07 16:12:36.597896 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-AttachVolumeNegativeTest-857872657 Sep 07 16:12:36.597896 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Role: reader,member Sep 07 16:12:36.597896 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Roles: reader,member Sep 07 16:12:36.599625 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ab1963a1a6684af58f5c240787788b60", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ab1963a1a6684af58f5c240787788b60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ab1963a1a6684af58f5c240787788b60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ab1963a1a6684af58f5c240787788b60"}]}] Sep 07 16:12:36.599625 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-AttachVolumeNegativeTest-857872657 Sep 07 16:12:36.599625 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Id: ab1963a1a6684af58f5c240787788b60 Sep 07 16:12:36.599625 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-857872657 Sep 07 16:12:36.599625 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User: tempest-AttachVolumeNegativeTest-857872657-project Sep 07 16:12:36.599625 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Sep 07 16:12:36.599625 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Sep 07 16:12:36.599625 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Id: 2dab44e593194fe788216b029eecd10c Sep 07 16:12:36.599625 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-AttachVolumeNegativeTest-857872657-project Sep 07 16:12:36.599625 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: method: > Sep 07 16:12:36.599625 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: exception: Instance 039917c5-d07d-48cc-8a1e-14b973a93bb9 could not be found. Sep 07 16:12:36.599625 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: action_args: {'id': '039917c5-d07d-48cc-8a1e-14b973a93bb9'} Sep 07 16:12:36.601078 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 16:12:36.601078 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:12:36.601078 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 16:12:36.601078 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 16:12:36.601078 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 16:12:36.601078 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 16:12:36.601078 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 16:12:36.601078 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 16:12:36.601078 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 16:12:36.601078 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 16:12:36.601078 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 039917c5-d07d-48cc-8a1e-14b973a93bb9 could not be found. Sep 07 16:12:36.601078 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:12:36.601078 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:12:36.601078 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:12:36.601078 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:12:36.601078 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:12:36.601078 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:12:36.601078 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 16:12:36.601078 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 16:12:36.601078 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 16:12:36.602674 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 16:12:36.602674 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 16:12:36.602674 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 16:12:36.602674 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 16:12:36.602674 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 16:12:36.602674 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 16:12:36.602674 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 16:12:36.602674 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 16:12:36.602674 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 16:12:36.602674 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 039917c5-d07d-48cc-8a1e-14b973a93bb9 could not be found. Sep 07 16:12:36.602674 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:12:36.602674 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:12:36.602674 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:12:36.602674 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:12:36.602674 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:12:36.602674 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:12:36.602674 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 16:12:36.602674 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 16:12:36.602674 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 039917c5-d07d-48cc-8a1e-14b973a93bb9 could not be found. Sep 07 16:12:36.602674 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:12:36.604369 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-86ccda3e-9873-44b2-a1af-862cbf65a371 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Returning 404 to user: Instance 039917c5-d07d-48cc-8a1e-14b973a93bb9 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 16:12:36.604369 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-86ccda3e-9873-44b2-a1af-862cbf65a371 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "DELETE /compute/v2.1/servers/039917c5-d07d-48cc-8a1e-14b973a93bb9" status: 404 len: 111 microversion: 2.1 time: 0.028986 Sep 07 16:12:36.604369 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 651/1281] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Sep 7 16:12:36 2022] DELETE /compute/v2.1/servers/039917c5-d07d-48cc-8a1e-14b973a93bb9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 16:12:36.607960 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-08b7d5b5-0dd4-465b-a915-039a0c6b1908 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:12:36.608571 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-08b7d5b5-0dd4-465b-a915-039a0c6b1908 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 039917c5-d07d-48cc-8a1e-14b973a93bb9] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:12:36.615526 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-08b7d5b5-0dd4-465b-a915-039a0c6b1908 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:36.616613 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-08b7d5b5-0dd4-465b-a915-039a0c6b1908 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:36.617048 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-08b7d5b5-0dd4-465b-a915-039a0c6b1908 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:36.617730 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-08b7d5b5-0dd4-465b-a915-039a0c6b1908 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:36.618185 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-08b7d5b5-0dd4-465b-a915-039a0c6b1908 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:36.618608 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-08b7d5b5-0dd4-465b-a915-039a0c6b1908 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:36.631312 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-08b7d5b5-0dd4-465b-a915-039a0c6b1908 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] HTTP exception thrown: Instance 039917c5-d07d-48cc-8a1e-14b973a93bb9 could not be found. Sep 07 16:12:36.632945 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-08b7d5b5-0dd4-465b-a915-039a0c6b1908 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Request method failure captured: Sep 07 16:12:36.632945 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/039917c5-d07d-48cc-8a1e-14b973a93bb9 HTTP/1.1 Sep 07 16:12:36.632945 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Accept: application/json Sep 07 16:12:36.632945 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Accept-Encoding: identity Sep 07 16:12:36.632945 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Connection: close Sep 07 16:12:36.632945 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Content-Length: 0 Sep 07 16:12:36.632945 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Content-Type: application/json Sep 07 16:12:36.632945 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Host: 10.222.0.17 Sep 07 16:12:36.632945 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Openstack-System-Scope: None Sep 07 16:12:36.632945 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Sep 07 16:12:36.632945 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjGMEEfdw4OUg2B39RKswOmT5z54ISjPs9Ys-pBh0gUFq_XPVQCzkiphko1MTfezgc9xGOiE9M4-fp-aoq8efmnODenpErT0vQYyVQWrBzaRRoo-wl5i6l7H-bvKljvP6w5U1cAwX2okeVPnYRC9X59Bw9YuV07_v6iRyvOmKt9QO33DU Sep 07 16:12:36.632945 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Domain-Id: None Sep 07 16:12:36.632945 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Domain-Name: None Sep 07 16:12:36.632945 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Identity-Status: Confirmed Sep 07 16:12:36.632945 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Is-Admin-Project: True Sep 07 16:12:36.632945 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Domain-Id: default Sep 07 16:12:36.632945 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Domain-Name: Default Sep 07 16:12:36.632945 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Id: ab1963a1a6684af58f5c240787788b60 Sep 07 16:12:36.632945 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Name: tempest-AttachVolumeNegativeTest-857872657 Sep 07 16:12:36.632945 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Role: reader,member Sep 07 16:12:36.632945 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Roles: reader,member Sep 07 16:12:36.634634 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ab1963a1a6684af58f5c240787788b60", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ab1963a1a6684af58f5c240787788b60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ab1963a1a6684af58f5c240787788b60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ab1963a1a6684af58f5c240787788b60"}]}] Sep 07 16:12:36.634634 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant: tempest-AttachVolumeNegativeTest-857872657 Sep 07 16:12:36.634634 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant-Id: ab1963a1a6684af58f5c240787788b60 Sep 07 16:12:36.634634 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-857872657 Sep 07 16:12:36.634634 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User: tempest-AttachVolumeNegativeTest-857872657-project Sep 07 16:12:36.634634 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Domain-Id: default Sep 07 16:12:36.634634 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Domain-Name: Default Sep 07 16:12:36.634634 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Id: 2dab44e593194fe788216b029eecd10c Sep 07 16:12:36.634634 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Name: tempest-AttachVolumeNegativeTest-857872657-project Sep 07 16:12:36.634634 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: method: > Sep 07 16:12:36.634634 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: exception: Instance 039917c5-d07d-48cc-8a1e-14b973a93bb9 could not be found. Sep 07 16:12:36.634634 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: action_args: {'id': '039917c5-d07d-48cc-8a1e-14b973a93bb9'} Sep 07 16:12:36.635686 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 16:12:36.635686 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:12:36.635686 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 16:12:36.635686 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 16:12:36.635686 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 16:12:36.635686 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 16:12:36.635686 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 16:12:36.635686 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 16:12:36.635686 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 16:12:36.635686 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 16:12:36.635686 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 039917c5-d07d-48cc-8a1e-14b973a93bb9 could not be found. Sep 07 16:12:36.635686 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:12:36.635686 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:12:36.635686 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:12:36.635686 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:12:36.635686 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:12:36.635686 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:12:36.635686 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 16:12:36.635686 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 16:12:36.635686 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 16:12:36.637297 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 16:12:36.637297 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 16:12:36.637297 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 16:12:36.637297 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 16:12:36.637297 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 16:12:36.637297 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 16:12:36.637297 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 16:12:36.637297 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 039917c5-d07d-48cc-8a1e-14b973a93bb9 could not be found. Sep 07 16:12:36.637297 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:12:36.637297 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:12:36.637297 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:12:36.637297 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:12:36.637297 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:12:36.637297 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:12:36.637297 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 16:12:36.637297 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 16:12:36.637297 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 039917c5-d07d-48cc-8a1e-14b973a93bb9 could not be found. Sep 07 16:12:36.637297 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:12:36.638727 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-08b7d5b5-0dd4-465b-a915-039a0c6b1908 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Returning 404 to user: Instance 039917c5-d07d-48cc-8a1e-14b973a93bb9 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 16:12:36.638727 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-08b7d5b5-0dd4-465b-a915-039a0c6b1908 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/039917c5-d07d-48cc-8a1e-14b973a93bb9" status: 404 len: 111 microversion: 2.1 time: 0.030138 Sep 07 16:12:36.638727 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 631/1282] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:12:36 2022] GET /compute/v2.1/servers/039917c5-d07d-48cc-8a1e-14b973a93bb9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 16:12:37.773134 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cbfab538-f3c4-43e7-9548-a3e6fbe4f463 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:12:37.773627 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-cbfab538-f3c4-43e7-9548-a3e6fbe4f463 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 423140e3-a552-44fd-969a-7d215a453863] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:12:37.779953 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cbfab538-f3c4-43e7-9548-a3e6fbe4f463 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:37.780433 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cbfab538-f3c4-43e7-9548-a3e6fbe4f463 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:37.780872 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cbfab538-f3c4-43e7-9548-a3e6fbe4f463 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:37.781561 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cbfab538-f3c4-43e7-9548-a3e6fbe4f463 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:37.782013 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cbfab538-f3c4-43e7-9548-a3e6fbe4f463 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:37.782437 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-cbfab538-f3c4-43e7-9548-a3e6fbe4f463 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:37.795472 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-cbfab538-f3c4-43e7-9548-a3e6fbe4f463 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] HTTP exception thrown: Instance 423140e3-a552-44fd-969a-7d215a453863 could not be found. Sep 07 16:12:37.797013 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cbfab538-f3c4-43e7-9548-a3e6fbe4f463 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Request method failure captured: Sep 07 16:12:37.797013 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: request: DELETE /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863 HTTP/1.1 Sep 07 16:12:37.797013 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept: application/json Sep 07 16:12:37.797013 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Sep 07 16:12:37.797013 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Connection: close Sep 07 16:12:37.797013 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Length: 0 Sep 07 16:12:37.797013 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Type: application/json Sep 07 16:12:37.797013 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Host: 10.222.0.17 Sep 07 16:12:37.797013 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Sep 07 16:12:37.797013 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Sep 07 16:12:37.797013 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjGMEEfdw4OUg2B39RKswOmT5z54ISjPs9Ys-pBh0gUFq_XPVQCzkiphko1MTfezgc9xGOiE9M4-fp-aoq8efmnODenpErT0vQYyVQWrBzaRRoo-wl5i6l7H-bvKljvP6w5U1cAwX2okeVPnYRC9X59Bw9YuV07_v6iRyvOmKt9QO33DU Sep 07 16:12:37.797013 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Sep 07 16:12:37.797013 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Sep 07 16:12:37.797013 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Sep 07 16:12:37.797013 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Sep 07 16:12:37.797013 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Sep 07 16:12:37.797013 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Sep 07 16:12:37.797013 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Id: ab1963a1a6684af58f5c240787788b60 Sep 07 16:12:37.797013 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-AttachVolumeNegativeTest-857872657 Sep 07 16:12:37.797013 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Role: reader,member Sep 07 16:12:37.797013 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Roles: reader,member Sep 07 16:12:37.798756 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ab1963a1a6684af58f5c240787788b60", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ab1963a1a6684af58f5c240787788b60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ab1963a1a6684af58f5c240787788b60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ab1963a1a6684af58f5c240787788b60"}]}] Sep 07 16:12:37.798756 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-AttachVolumeNegativeTest-857872657 Sep 07 16:12:37.798756 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Id: ab1963a1a6684af58f5c240787788b60 Sep 07 16:12:37.798756 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-857872657 Sep 07 16:12:37.798756 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User: tempest-AttachVolumeNegativeTest-857872657-project Sep 07 16:12:37.798756 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Sep 07 16:12:37.798756 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Sep 07 16:12:37.798756 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Id: 2dab44e593194fe788216b029eecd10c Sep 07 16:12:37.798756 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-AttachVolumeNegativeTest-857872657-project Sep 07 16:12:37.798756 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: method: > Sep 07 16:12:37.798756 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: exception: Instance 423140e3-a552-44fd-969a-7d215a453863 could not be found. Sep 07 16:12:37.798756 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: action_args: {'id': '423140e3-a552-44fd-969a-7d215a453863'} Sep 07 16:12:37.799847 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 16:12:37.799847 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:12:37.799847 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 16:12:37.799847 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 16:12:37.799847 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 16:12:37.799847 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 16:12:37.799847 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 16:12:37.799847 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 16:12:37.799847 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 16:12:37.799847 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 16:12:37.799847 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 423140e3-a552-44fd-969a-7d215a453863 could not be found. Sep 07 16:12:37.799847 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:12:37.799847 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:12:37.799847 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:12:37.799847 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:12:37.799847 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:12:37.799847 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:12:37.799847 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 16:12:37.799847 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 16:12:37.799847 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 16:12:37.801454 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 16:12:37.801454 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 16:12:37.801454 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 16:12:37.801454 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 16:12:37.801454 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 16:12:37.801454 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 16:12:37.801454 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 16:12:37.801454 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 16:12:37.801454 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 16:12:37.801454 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 423140e3-a552-44fd-969a-7d215a453863 could not be found. Sep 07 16:12:37.801454 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:12:37.801454 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:12:37.801454 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:12:37.801454 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:12:37.801454 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:12:37.801454 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:12:37.801454 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 16:12:37.801454 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 16:12:37.801454 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 423140e3-a552-44fd-969a-7d215a453863 could not be found. Sep 07 16:12:37.801454 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:12:37.803841 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-cbfab538-f3c4-43e7-9548-a3e6fbe4f463 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Returning 404 to user: Instance 423140e3-a552-44fd-969a-7d215a453863 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 16:12:37.803841 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-cbfab538-f3c4-43e7-9548-a3e6fbe4f463 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "DELETE /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863" status: 404 len: 111 microversion: 2.1 time: 0.029098 Sep 07 16:12:37.803841 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 652/1283] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Sep 7 16:12:37 2022] DELETE /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 16:12:37.806929 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ef7003ef-38de-408d-931b-dea5549629a8 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:12:37.807588 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-ef7003ef-38de-408d-931b-dea5549629a8 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 423140e3-a552-44fd-969a-7d215a453863] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:12:37.813619 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ef7003ef-38de-408d-931b-dea5549629a8 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:37.814094 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ef7003ef-38de-408d-931b-dea5549629a8 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:37.814525 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ef7003ef-38de-408d-931b-dea5549629a8 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:37.815205 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ef7003ef-38de-408d-931b-dea5549629a8 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:37.815677 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ef7003ef-38de-408d-931b-dea5549629a8 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:37.816097 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-ef7003ef-38de-408d-931b-dea5549629a8 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:37.829632 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-ef7003ef-38de-408d-931b-dea5549629a8 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] HTTP exception thrown: Instance 423140e3-a552-44fd-969a-7d215a453863 could not be found. Sep 07 16:12:37.831116 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ef7003ef-38de-408d-931b-dea5549629a8 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Request method failure captured: Sep 07 16:12:37.831116 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863 HTTP/1.1 Sep 07 16:12:37.831116 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Accept: application/json Sep 07 16:12:37.831116 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Accept-Encoding: identity Sep 07 16:12:37.831116 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Connection: close Sep 07 16:12:37.831116 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Content-Length: 0 Sep 07 16:12:37.831116 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Content-Type: application/json Sep 07 16:12:37.831116 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Host: 10.222.0.17 Sep 07 16:12:37.831116 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Openstack-System-Scope: None Sep 07 16:12:37.831116 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Sep 07 16:12:37.831116 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjGMEEfdw4OUg2B39RKswOmT5z54ISjPs9Ys-pBh0gUFq_XPVQCzkiphko1MTfezgc9xGOiE9M4-fp-aoq8efmnODenpErT0vQYyVQWrBzaRRoo-wl5i6l7H-bvKljvP6w5U1cAwX2okeVPnYRC9X59Bw9YuV07_v6iRyvOmKt9QO33DU Sep 07 16:12:37.831116 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Domain-Id: None Sep 07 16:12:37.831116 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Domain-Name: None Sep 07 16:12:37.831116 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Identity-Status: Confirmed Sep 07 16:12:37.831116 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Is-Admin-Project: True Sep 07 16:12:37.831116 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Domain-Id: default Sep 07 16:12:37.831116 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Domain-Name: Default Sep 07 16:12:37.831116 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Id: ab1963a1a6684af58f5c240787788b60 Sep 07 16:12:37.831116 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Name: tempest-AttachVolumeNegativeTest-857872657 Sep 07 16:12:37.831116 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Role: reader,member Sep 07 16:12:37.831116 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Roles: reader,member Sep 07 16:12:37.832934 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ab1963a1a6684af58f5c240787788b60", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ab1963a1a6684af58f5c240787788b60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ab1963a1a6684af58f5c240787788b60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ab1963a1a6684af58f5c240787788b60"}]}] Sep 07 16:12:37.832934 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant: tempest-AttachVolumeNegativeTest-857872657 Sep 07 16:12:37.832934 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant-Id: ab1963a1a6684af58f5c240787788b60 Sep 07 16:12:37.832934 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-857872657 Sep 07 16:12:37.832934 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User: tempest-AttachVolumeNegativeTest-857872657-project Sep 07 16:12:37.832934 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Domain-Id: default Sep 07 16:12:37.832934 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Domain-Name: Default Sep 07 16:12:37.832934 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Id: 2dab44e593194fe788216b029eecd10c Sep 07 16:12:37.832934 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Name: tempest-AttachVolumeNegativeTest-857872657-project Sep 07 16:12:37.832934 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: method: > Sep 07 16:12:37.832934 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: exception: Instance 423140e3-a552-44fd-969a-7d215a453863 could not be found. Sep 07 16:12:37.832934 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: action_args: {'id': '423140e3-a552-44fd-969a-7d215a453863'} Sep 07 16:12:37.833875 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 16:12:37.833875 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:12:37.833875 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 16:12:37.833875 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 16:12:37.833875 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 16:12:37.833875 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 16:12:37.833875 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 16:12:37.833875 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 16:12:37.833875 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 16:12:37.833875 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 16:12:37.833875 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 423140e3-a552-44fd-969a-7d215a453863 could not be found. Sep 07 16:12:37.833875 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:12:37.833875 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:12:37.833875 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:12:37.833875 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:12:37.833875 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:12:37.833875 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:12:37.833875 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 16:12:37.833875 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 16:12:37.833875 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 16:12:37.835452 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 16:12:37.835452 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 16:12:37.835452 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 16:12:37.835452 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 16:12:37.835452 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 16:12:37.835452 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 16:12:37.835452 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 16:12:37.835452 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 423140e3-a552-44fd-969a-7d215a453863 could not be found. Sep 07 16:12:37.835452 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:12:37.835452 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:12:37.835452 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:12:37.835452 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:12:37.835452 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:12:37.835452 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:12:37.835452 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 16:12:37.835452 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 16:12:37.835452 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 423140e3-a552-44fd-969a-7d215a453863 could not be found. Sep 07 16:12:37.835452 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:12:37.836923 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-ef7003ef-38de-408d-931b-dea5549629a8 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Returning 404 to user: Instance 423140e3-a552-44fd-969a-7d215a453863 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 16:12:37.836923 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-ef7003ef-38de-408d-931b-dea5549629a8 tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863" status: 404 len: 111 microversion: 2.1 time: 0.029763 Sep 07 16:12:37.836923 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 632/1284] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:12:37 2022] GET /compute/v2.1/servers/423140e3-a552-44fd-969a-7d215a453863 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 16:12:37.840561 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-429a76c2-5e73-4cca-8477-fd13f349faba tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:12:37.841079 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-429a76c2-5e73-4cca-8477-fd13f349faba tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: d43ccf07-e0c3-46a2-b4f2-00db2672aced] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:12:37.847125 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-429a76c2-5e73-4cca-8477-fd13f349faba tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:37.847636 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-429a76c2-5e73-4cca-8477-fd13f349faba tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:37.848074 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-429a76c2-5e73-4cca-8477-fd13f349faba tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:37.848753 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-429a76c2-5e73-4cca-8477-fd13f349faba tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:37.849204 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-429a76c2-5e73-4cca-8477-fd13f349faba tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:37.849625 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-429a76c2-5e73-4cca-8477-fd13f349faba tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:37.862515 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-429a76c2-5e73-4cca-8477-fd13f349faba tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] HTTP exception thrown: Instance d43ccf07-e0c3-46a2-b4f2-00db2672aced could not be found. Sep 07 16:12:37.864047 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-429a76c2-5e73-4cca-8477-fd13f349faba tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Request method failure captured: Sep 07 16:12:37.864047 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: request: DELETE /compute/v2.1/servers/d43ccf07-e0c3-46a2-b4f2-00db2672aced HTTP/1.1 Sep 07 16:12:37.864047 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept: application/json Sep 07 16:12:37.864047 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Sep 07 16:12:37.864047 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Connection: close Sep 07 16:12:37.864047 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Length: 0 Sep 07 16:12:37.864047 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Type: application/json Sep 07 16:12:37.864047 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Host: 10.222.0.17 Sep 07 16:12:37.864047 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Sep 07 16:12:37.864047 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Sep 07 16:12:37.864047 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjGMEEfdw4OUg2B39RKswOmT5z54ISjPs9Ys-pBh0gUFq_XPVQCzkiphko1MTfezgc9xGOiE9M4-fp-aoq8efmnODenpErT0vQYyVQWrBzaRRoo-wl5i6l7H-bvKljvP6w5U1cAwX2okeVPnYRC9X59Bw9YuV07_v6iRyvOmKt9QO33DU Sep 07 16:12:37.864047 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Sep 07 16:12:37.864047 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Sep 07 16:12:37.864047 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Sep 07 16:12:37.864047 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Sep 07 16:12:37.864047 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Sep 07 16:12:37.864047 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Sep 07 16:12:37.864047 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Id: ab1963a1a6684af58f5c240787788b60 Sep 07 16:12:37.864047 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-AttachVolumeNegativeTest-857872657 Sep 07 16:12:37.864047 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Role: reader,member Sep 07 16:12:37.864047 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Roles: reader,member Sep 07 16:12:37.866326 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ab1963a1a6684af58f5c240787788b60", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ab1963a1a6684af58f5c240787788b60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ab1963a1a6684af58f5c240787788b60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ab1963a1a6684af58f5c240787788b60"}]}] Sep 07 16:12:37.866326 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-AttachVolumeNegativeTest-857872657 Sep 07 16:12:37.866326 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Id: ab1963a1a6684af58f5c240787788b60 Sep 07 16:12:37.866326 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-857872657 Sep 07 16:12:37.866326 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User: tempest-AttachVolumeNegativeTest-857872657-project Sep 07 16:12:37.866326 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Sep 07 16:12:37.866326 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Sep 07 16:12:37.866326 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Id: 2dab44e593194fe788216b029eecd10c Sep 07 16:12:37.866326 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-AttachVolumeNegativeTest-857872657-project Sep 07 16:12:37.866326 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: method: > Sep 07 16:12:37.866326 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: exception: Instance d43ccf07-e0c3-46a2-b4f2-00db2672aced could not be found. Sep 07 16:12:37.866326 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: action_args: {'id': 'd43ccf07-e0c3-46a2-b4f2-00db2672aced'} Sep 07 16:12:37.867383 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 16:12:37.867383 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:12:37.867383 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 16:12:37.867383 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 16:12:37.867383 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 16:12:37.867383 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 16:12:37.867383 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 16:12:37.867383 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 16:12:37.867383 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 16:12:37.867383 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 16:12:37.867383 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d43ccf07-e0c3-46a2-b4f2-00db2672aced could not be found. Sep 07 16:12:37.867383 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:12:37.867383 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:12:37.867383 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:12:37.867383 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:12:37.867383 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:12:37.867383 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:12:37.867383 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 16:12:37.867383 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 16:12:37.867383 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 16:12:37.868984 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 16:12:37.868984 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 16:12:37.868984 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 16:12:37.868984 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 16:12:37.868984 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 16:12:37.868984 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 16:12:37.868984 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 16:12:37.868984 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 16:12:37.868984 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 16:12:37.868984 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d43ccf07-e0c3-46a2-b4f2-00db2672aced could not be found. Sep 07 16:12:37.868984 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:12:37.868984 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:12:37.868984 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:12:37.868984 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:12:37.868984 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:12:37.868984 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:12:37.868984 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 16:12:37.868984 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 16:12:37.868984 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d43ccf07-e0c3-46a2-b4f2-00db2672aced could not be found. Sep 07 16:12:37.868984 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:12:37.870690 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-429a76c2-5e73-4cca-8477-fd13f349faba tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Returning 404 to user: Instance d43ccf07-e0c3-46a2-b4f2-00db2672aced could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 16:12:37.870690 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-429a76c2-5e73-4cca-8477-fd13f349faba tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d43ccf07-e0c3-46a2-b4f2-00db2672aced" status: 404 len: 111 microversion: 2.1 time: 0.028621 Sep 07 16:12:37.870690 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 653/1285] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Sep 7 16:12:37 2022] DELETE /compute/v2.1/servers/d43ccf07-e0c3-46a2-b4f2-00db2672aced => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 16:12:37.873979 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f3e25e16-d1ab-4af9-a684-5d031169b80b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:12:37.874631 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-f3e25e16-d1ab-4af9-a684-5d031169b80b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: d43ccf07-e0c3-46a2-b4f2-00db2672aced] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:12:37.880678 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f3e25e16-d1ab-4af9-a684-5d031169b80b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:37.881158 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f3e25e16-d1ab-4af9-a684-5d031169b80b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:37.882210 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f3e25e16-d1ab-4af9-a684-5d031169b80b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:37.882890 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f3e25e16-d1ab-4af9-a684-5d031169b80b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:37.883338 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f3e25e16-d1ab-4af9-a684-5d031169b80b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:37.883781 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-f3e25e16-d1ab-4af9-a684-5d031169b80b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:37.896733 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-f3e25e16-d1ab-4af9-a684-5d031169b80b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] HTTP exception thrown: Instance d43ccf07-e0c3-46a2-b4f2-00db2672aced could not be found. Sep 07 16:12:37.898204 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f3e25e16-d1ab-4af9-a684-5d031169b80b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Request method failure captured: Sep 07 16:12:37.898204 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/d43ccf07-e0c3-46a2-b4f2-00db2672aced HTTP/1.1 Sep 07 16:12:37.898204 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Accept: application/json Sep 07 16:12:37.898204 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Accept-Encoding: identity Sep 07 16:12:37.898204 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Connection: close Sep 07 16:12:37.898204 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Content-Length: 0 Sep 07 16:12:37.898204 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Content-Type: application/json Sep 07 16:12:37.898204 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Host: 10.222.0.17 Sep 07 16:12:37.898204 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Openstack-System-Scope: None Sep 07 16:12:37.898204 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Sep 07 16:12:37.898204 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjGMEEfdw4OUg2B39RKswOmT5z54ISjPs9Ys-pBh0gUFq_XPVQCzkiphko1MTfezgc9xGOiE9M4-fp-aoq8efmnODenpErT0vQYyVQWrBzaRRoo-wl5i6l7H-bvKljvP6w5U1cAwX2okeVPnYRC9X59Bw9YuV07_v6iRyvOmKt9QO33DU Sep 07 16:12:37.898204 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Domain-Id: None Sep 07 16:12:37.898204 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Domain-Name: None Sep 07 16:12:37.898204 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Identity-Status: Confirmed Sep 07 16:12:37.898204 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Is-Admin-Project: True Sep 07 16:12:37.898204 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Domain-Id: default Sep 07 16:12:37.898204 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Domain-Name: Default Sep 07 16:12:37.898204 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Id: ab1963a1a6684af58f5c240787788b60 Sep 07 16:12:37.898204 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Name: tempest-AttachVolumeNegativeTest-857872657 Sep 07 16:12:37.898204 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Role: reader,member Sep 07 16:12:37.898204 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Roles: reader,member Sep 07 16:12:37.899920 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ab1963a1a6684af58f5c240787788b60", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ab1963a1a6684af58f5c240787788b60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ab1963a1a6684af58f5c240787788b60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ab1963a1a6684af58f5c240787788b60"}]}] Sep 07 16:12:37.899920 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant: tempest-AttachVolumeNegativeTest-857872657 Sep 07 16:12:37.899920 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant-Id: ab1963a1a6684af58f5c240787788b60 Sep 07 16:12:37.899920 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-857872657 Sep 07 16:12:37.899920 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User: tempest-AttachVolumeNegativeTest-857872657-project Sep 07 16:12:37.899920 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Domain-Id: default Sep 07 16:12:37.899920 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Domain-Name: Default Sep 07 16:12:37.899920 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Id: 2dab44e593194fe788216b029eecd10c Sep 07 16:12:37.899920 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Name: tempest-AttachVolumeNegativeTest-857872657-project Sep 07 16:12:37.899920 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: method: > Sep 07 16:12:37.899920 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: exception: Instance d43ccf07-e0c3-46a2-b4f2-00db2672aced could not be found. Sep 07 16:12:37.899920 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: action_args: {'id': 'd43ccf07-e0c3-46a2-b4f2-00db2672aced'} Sep 07 16:12:37.900909 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 16:12:37.900909 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:12:37.900909 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 16:12:37.900909 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 16:12:37.900909 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 16:12:37.900909 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 16:12:37.900909 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 16:12:37.900909 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 16:12:37.900909 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 16:12:37.900909 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 16:12:37.900909 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d43ccf07-e0c3-46a2-b4f2-00db2672aced could not be found. Sep 07 16:12:37.900909 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:12:37.900909 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:12:37.900909 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:12:37.900909 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:12:37.900909 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:12:37.900909 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:12:37.900909 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 16:12:37.900909 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 16:12:37.900909 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 16:12:37.902521 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 16:12:37.902521 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 16:12:37.902521 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 16:12:37.902521 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 16:12:37.902521 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 16:12:37.902521 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 16:12:37.902521 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 16:12:37.902521 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d43ccf07-e0c3-46a2-b4f2-00db2672aced could not be found. Sep 07 16:12:37.902521 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:12:37.902521 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:12:37.902521 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:12:37.902521 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:12:37.902521 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:12:37.902521 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:12:37.902521 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 16:12:37.902521 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 16:12:37.902521 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d43ccf07-e0c3-46a2-b4f2-00db2672aced could not be found. Sep 07 16:12:37.902521 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:12:37.904090 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-f3e25e16-d1ab-4af9-a684-5d031169b80b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Returning 404 to user: Instance d43ccf07-e0c3-46a2-b4f2-00db2672aced could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 16:12:37.904090 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-f3e25e16-d1ab-4af9-a684-5d031169b80b tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/d43ccf07-e0c3-46a2-b4f2-00db2672aced" status: 404 len: 111 microversion: 2.1 time: 0.029299 Sep 07 16:12:37.904090 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 633/1286] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:12:37 2022] GET /compute/v2.1/servers/d43ccf07-e0c3-46a2-b4f2-00db2672aced => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 16:12:39.039052 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-29908a45-c6b6-4771-a1e8-8f47a7be5b9a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:12:39.039534 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-29908a45-c6b6-4771-a1e8-8f47a7be5b9a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 8ae4d7f1-1422-4346-84ab-72682ad0a928] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:12:39.047284 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-29908a45-c6b6-4771-a1e8-8f47a7be5b9a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:39.047868 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-29908a45-c6b6-4771-a1e8-8f47a7be5b9a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:39.048309 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-29908a45-c6b6-4771-a1e8-8f47a7be5b9a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:39.049014 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-29908a45-c6b6-4771-a1e8-8f47a7be5b9a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:39.049462 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-29908a45-c6b6-4771-a1e8-8f47a7be5b9a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:39.049881 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-29908a45-c6b6-4771-a1e8-8f47a7be5b9a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:39.063209 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.wsgi [None req-29908a45-c6b6-4771-a1e8-8f47a7be5b9a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] HTTP exception thrown: Instance 8ae4d7f1-1422-4346-84ab-72682ad0a928 could not be found. Sep 07 16:12:39.064795 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-29908a45-c6b6-4771-a1e8-8f47a7be5b9a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Request method failure captured: Sep 07 16:12:39.064795 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: request: DELETE /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928 HTTP/1.1 Sep 07 16:12:39.064795 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept: application/json Sep 07 16:12:39.064795 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Accept-Encoding: identity Sep 07 16:12:39.064795 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Connection: close Sep 07 16:12:39.064795 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Length: 0 Sep 07 16:12:39.064795 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Content-Type: application/json Sep 07 16:12:39.064795 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Host: 10.222.0.17 Sep 07 16:12:39.064795 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Openstack-System-Scope: None Sep 07 16:12:39.064795 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: User-Agent: python-urllib3/1.26.12 Sep 07 16:12:39.064795 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Auth-Token: gAAAAABjGMEEfdw4OUg2B39RKswOmT5z54ISjPs9Ys-pBh0gUFq_XPVQCzkiphko1MTfezgc9xGOiE9M4-fp-aoq8efmnODenpErT0vQYyVQWrBzaRRoo-wl5i6l7H-bvKljvP6w5U1cAwX2okeVPnYRC9X59Bw9YuV07_v6iRyvOmKt9QO33DU Sep 07 16:12:39.064795 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Id: None Sep 07 16:12:39.064795 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Domain-Name: None Sep 07 16:12:39.064795 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Identity-Status: Confirmed Sep 07 16:12:39.064795 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Is-Admin-Project: True Sep 07 16:12:39.064795 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Id: default Sep 07 16:12:39.064795 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Domain-Name: Default Sep 07 16:12:39.064795 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Id: ab1963a1a6684af58f5c240787788b60 Sep 07 16:12:39.064795 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Project-Name: tempest-AttachVolumeNegativeTest-857872657 Sep 07 16:12:39.064795 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Role: reader,member Sep 07 16:12:39.064795 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Roles: reader,member Sep 07 16:12:39.066449 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ab1963a1a6684af58f5c240787788b60", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ab1963a1a6684af58f5c240787788b60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ab1963a1a6684af58f5c240787788b60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ab1963a1a6684af58f5c240787788b60"}]}] Sep 07 16:12:39.066449 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant: tempest-AttachVolumeNegativeTest-857872657 Sep 07 16:12:39.066449 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Id: ab1963a1a6684af58f5c240787788b60 Sep 07 16:12:39.066449 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-857872657 Sep 07 16:12:39.066449 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User: tempest-AttachVolumeNegativeTest-857872657-project Sep 07 16:12:39.066449 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Id: default Sep 07 16:12:39.066449 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Domain-Name: Default Sep 07 16:12:39.066449 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Id: 2dab44e593194fe788216b029eecd10c Sep 07 16:12:39.066449 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: X-User-Name: tempest-AttachVolumeNegativeTest-857872657-project Sep 07 16:12:39.066449 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: method: > Sep 07 16:12:39.066449 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: exception: Instance 8ae4d7f1-1422-4346-84ab-72682ad0a928 could not be found. Sep 07 16:12:39.066449 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: action_args: {'id': '8ae4d7f1-1422-4346-84ab-72682ad0a928'} Sep 07 16:12:39.067355 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 16:12:39.067355 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:12:39.067355 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 16:12:39.067355 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 16:12:39.067355 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 16:12:39.067355 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 16:12:39.067355 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 16:12:39.067355 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 16:12:39.067355 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 16:12:39.067355 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 16:12:39.067355 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ae4d7f1-1422-4346-84ab-72682ad0a928 could not be found. Sep 07 16:12:39.067355 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:12:39.067355 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:12:39.067355 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:12:39.067355 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:12:39.067355 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:12:39.067355 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:12:39.067355 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 16:12:39.067355 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 16:12:39.067355 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 16:12:39.069286 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 16:12:39.069286 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 16:12:39.069286 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 16:12:39.069286 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 16:12:39.069286 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 16:12:39.069286 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 16:12:39.069286 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 16:12:39.069286 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 16:12:39.069286 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 16:12:39.069286 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ae4d7f1-1422-4346-84ab-72682ad0a928 could not be found. Sep 07 16:12:39.069286 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:12:39.069286 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:12:39.069286 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:12:39.069286 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:12:39.069286 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:12:39.069286 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:12:39.069286 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 16:12:39.069286 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 16:12:39.069286 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ae4d7f1-1422-4346-84ab-72682ad0a928 could not be found. Sep 07 16:12:39.069286 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: ERROR nova.api.openstack.wsgi Sep 07 16:12:39.070619 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-29908a45-c6b6-4771-a1e8-8f47a7be5b9a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Returning 404 to user: Instance 8ae4d7f1-1422-4346-84ab-72682ad0a928 could not be found. {{(pid=120640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 16:12:39.070619 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-29908a45-c6b6-4771-a1e8-8f47a7be5b9a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928" status: 404 len: 111 microversion: 2.1 time: 0.030979 Sep 07 16:12:39.070619 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 654/1287] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Sep 7 16:12:39 2022] DELETE /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 16:12:39.074924 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-72c5009c-dc40-4ede-8302-31b5a8ef425a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:12:39.075561 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-72c5009c-dc40-4ede-8302-31b5a8ef425a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] [instance: 8ae4d7f1-1422-4346-84ab-72682ad0a928] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:12:39.081547 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72c5009c-dc40-4ede-8302-31b5a8ef425a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:39.082032 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72c5009c-dc40-4ede-8302-31b5a8ef425a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:39.082471 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72c5009c-dc40-4ede-8302-31b5a8ef425a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:39.083158 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72c5009c-dc40-4ede-8302-31b5a8ef425a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:12:39.083642 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72c5009c-dc40-4ede-8302-31b5a8ef425a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:12:39.084072 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-72c5009c-dc40-4ede-8302-31b5a8ef425a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:12:39.098029 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-72c5009c-dc40-4ede-8302-31b5a8ef425a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] HTTP exception thrown: Instance 8ae4d7f1-1422-4346-84ab-72682ad0a928 could not be found. Sep 07 16:12:39.099531 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-72c5009c-dc40-4ede-8302-31b5a8ef425a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Request method failure captured: Sep 07 16:12:39.099531 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928 HTTP/1.1 Sep 07 16:12:39.099531 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Accept: application/json Sep 07 16:12:39.099531 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Accept-Encoding: identity Sep 07 16:12:39.099531 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Connection: close Sep 07 16:12:39.099531 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Content-Length: 0 Sep 07 16:12:39.099531 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Content-Type: application/json Sep 07 16:12:39.099531 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Host: 10.222.0.17 Sep 07 16:12:39.099531 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Openstack-System-Scope: None Sep 07 16:12:39.099531 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Sep 07 16:12:39.099531 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjGMEEfdw4OUg2B39RKswOmT5z54ISjPs9Ys-pBh0gUFq_XPVQCzkiphko1MTfezgc9xGOiE9M4-fp-aoq8efmnODenpErT0vQYyVQWrBzaRRoo-wl5i6l7H-bvKljvP6w5U1cAwX2okeVPnYRC9X59Bw9YuV07_v6iRyvOmKt9QO33DU Sep 07 16:12:39.099531 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Domain-Id: None Sep 07 16:12:39.099531 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Domain-Name: None Sep 07 16:12:39.099531 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Identity-Status: Confirmed Sep 07 16:12:39.099531 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Is-Admin-Project: True Sep 07 16:12:39.099531 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Domain-Id: default Sep 07 16:12:39.099531 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Domain-Name: Default Sep 07 16:12:39.099531 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Id: ab1963a1a6684af58f5c240787788b60 Sep 07 16:12:39.099531 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Name: tempest-AttachVolumeNegativeTest-857872657 Sep 07 16:12:39.099531 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Role: reader,member Sep 07 16:12:39.099531 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Roles: reader,member Sep 07 16:12:39.101097 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ab1963a1a6684af58f5c240787788b60", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ab1963a1a6684af58f5c240787788b60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ab1963a1a6684af58f5c240787788b60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ab1963a1a6684af58f5c240787788b60"}]}] Sep 07 16:12:39.101097 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant: tempest-AttachVolumeNegativeTest-857872657 Sep 07 16:12:39.101097 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant-Id: ab1963a1a6684af58f5c240787788b60 Sep 07 16:12:39.101097 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-857872657 Sep 07 16:12:39.101097 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User: tempest-AttachVolumeNegativeTest-857872657-project Sep 07 16:12:39.101097 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Domain-Id: default Sep 07 16:12:39.101097 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Domain-Name: Default Sep 07 16:12:39.101097 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Id: 2dab44e593194fe788216b029eecd10c Sep 07 16:12:39.101097 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Name: tempest-AttachVolumeNegativeTest-857872657-project Sep 07 16:12:39.101097 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: method: > Sep 07 16:12:39.101097 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: exception: Instance 8ae4d7f1-1422-4346-84ab-72682ad0a928 could not be found. Sep 07 16:12:39.101097 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: action_args: {'id': '8ae4d7f1-1422-4346-84ab-72682ad0a928'} Sep 07 16:12:39.102309 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 16:12:39.102309 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:12:39.102309 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 16:12:39.102309 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 16:12:39.102309 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 16:12:39.102309 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 16:12:39.102309 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 16:12:39.102309 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 16:12:39.102309 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 16:12:39.102309 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 16:12:39.102309 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ae4d7f1-1422-4346-84ab-72682ad0a928 could not be found. Sep 07 16:12:39.102309 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:12:39.102309 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:12:39.102309 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:12:39.102309 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:12:39.102309 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:12:39.102309 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:12:39.102309 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 16:12:39.102309 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 16:12:39.102309 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 16:12:39.103897 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 16:12:39.103897 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 16:12:39.103897 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 16:12:39.103897 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 16:12:39.103897 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 16:12:39.103897 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 16:12:39.103897 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 16:12:39.103897 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ae4d7f1-1422-4346-84ab-72682ad0a928 could not be found. Sep 07 16:12:39.103897 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:12:39.103897 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:12:39.103897 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:12:39.103897 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:12:39.103897 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:12:39.103897 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:12:39.103897 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 16:12:39.103897 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 16:12:39.103897 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ae4d7f1-1422-4346-84ab-72682ad0a928 could not be found. Sep 07 16:12:39.103897 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:12:39.105494 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-72c5009c-dc40-4ede-8302-31b5a8ef425a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] Returning 404 to user: Instance 8ae4d7f1-1422-4346-84ab-72682ad0a928 could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 16:12:39.105494 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-72c5009c-dc40-4ede-8302-31b5a8ef425a tempest-AttachVolumeNegativeTest-857872657 tempest-AttachVolumeNegativeTest-857872657-project] 10.222.0.17 "GET /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928" status: 404 len: 111 microversion: 2.1 time: 0.029709 Sep 07 16:12:39.105494 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 634/1288] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:12:39 2022] GET /compute/v2.1/servers/8ae4d7f1-1422-4346-84ab-72682ad0a928 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 16:14:06.598503 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:14:06.599235 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG dbcounter [-] [120640] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:14:06.601107 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 16:14:06.601981 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: Wed Sep 7 16:14:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c (ip 10.222.0.17) !!! Sep 07 16:14:06.603939 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:14:06.604904 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG dbcounter [-] [120641] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=120641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:14:06.606100 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 16:14:06.606251 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Wed Sep 7 16:14:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.17) !!! Sep 07 16:14:06.606403 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-7d673be7-e16a-49ad-adb8-c754e0b7ba5d tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:14:06.606912 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7d673be7-e16a-49ad-adb8-c754e0b7ba5d tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:14:06.615869 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d673be7-e16a-49ad-adb8-c754e0b7ba5d tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:14:06.616693 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d673be7-e16a-49ad-adb8-c754e0b7ba5d tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:14:06.617905 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d673be7-e16a-49ad-adb8-c754e0b7ba5d tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:14:06.618725 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d673be7-e16a-49ad-adb8-c754e0b7ba5d tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:14:06.619252 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d673be7-e16a-49ad-adb8-c754e0b7ba5d tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:14:06.619926 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-7d673be7-e16a-49ad-adb8-c754e0b7ba5d tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:14:06.649910 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-7d673be7-e16a-49ad-adb8-c754e0b7ba5d tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Going to try to terminate instance {{(pid=120640) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 16:14:06.732985 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-7d673be7-e16a-49ad-adb8-c754e0b7ba5d tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 204 len: 0 microversion: 2.1 time: 0.136269 Sep 07 16:14:06.733907 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 655/1289] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Sep 7 16:14:06 2022] DELETE /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 16:14:06.745297 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-695987df-6851-4153-b5c9-e88496546da5 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:14:06.746125 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-695987df-6851-4153-b5c9-e88496546da5 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:14:06.752294 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-695987df-6851-4153-b5c9-e88496546da5 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:14:06.752773 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-695987df-6851-4153-b5c9-e88496546da5 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:14:06.753450 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-695987df-6851-4153-b5c9-e88496546da5 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:14:06.753882 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-695987df-6851-4153-b5c9-e88496546da5 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:14:06.754327 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-695987df-6851-4153-b5c9-e88496546da5 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:14:06.754770 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-695987df-6851-4153-b5c9-e88496546da5 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:14:06.758378 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-99f1b9fb-484b-4d2a-b5b9-fa04a2bc75ad req-b603e35b-8280-4cbd-9576-9da2a99bbd74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d25048e4-93d0-458e-bbe5-ba0a380f4b0c", "tag": "430afbde-c047-4cf7-8a6c-587bd546651c"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:14:06.767760 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-99f1b9fb-484b-4d2a-b5b9-fa04a2bc75ad req-b603e35b-8280-4cbd-9576-9da2a99bbd74 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:14:06.768235 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-99f1b9fb-484b-4d2a-b5b9-fa04a2bc75ad req-b603e35b-8280-4cbd-9576-9da2a99bbd74 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:14:06.768665 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-99f1b9fb-484b-4d2a-b5b9-fa04a2bc75ad req-b603e35b-8280-4cbd-9576-9da2a99bbd74 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:14:06.779981 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-99f1b9fb-484b-4d2a-b5b9-fa04a2bc75ad req-b603e35b-8280-4cbd-9576-9da2a99bbd74 service nova] Creating event network-changed:430afbde-c047-4cf7-8a6c-587bd546651c for instance d25048e4-93d0-458e-bbe5-ba0a380f4b0c on hv-cinder-85331 Sep 07 16:14:06.792755 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-99f1b9fb-484b-4d2a-b5b9-fa04a2bc75ad req-b603e35b-8280-4cbd-9576-9da2a99bbd74 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.193234 Sep 07 16:14:06.793485 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 635/1290] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 16:14:06.892358 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-695987df-6851-4153-b5c9-e88496546da5 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aa615f2c7c4c6eaa694f551e38436a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266789e160554ec0a0a334304a0ad39d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:14:06.900618 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-695987df-6851-4153-b5c9-e88496546da5 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 200 len: 1568 microversion: 2.1 time: 0.160307 Sep 07 16:14:06.901176 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 656/1291] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:14:06 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:14:07.925272 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-8671cf05-f457-41c6-8d87-6e567d50eba6 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:14:07.925969 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-8671cf05-f457-41c6-8d87-6e567d50eba6 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:14:07.932566 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8671cf05-f457-41c6-8d87-6e567d50eba6 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:14:07.933051 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8671cf05-f457-41c6-8d87-6e567d50eba6 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:14:07.933483 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8671cf05-f457-41c6-8d87-6e567d50eba6 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:14:07.934172 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8671cf05-f457-41c6-8d87-6e567d50eba6 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:14:07.934622 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8671cf05-f457-41c6-8d87-6e567d50eba6 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:14:07.935043 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-8671cf05-f457-41c6-8d87-6e567d50eba6 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:14:08.075122 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.policy [None req-8671cf05-f457-41c6-8d87-6e567d50eba6 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aa615f2c7c4c6eaa694f551e38436a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266789e160554ec0a0a334304a0ad39d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120641) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:14:08.082914 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-8671cf05-f457-41c6-8d87-6e567d50eba6 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 200 len: 1568 microversion: 2.1 time: 0.162417 Sep 07 16:14:08.083482 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 636/1292] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:14:07 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:14:09.106237 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-b0208e5a-46ea-46b2-b8b3-6ae9406db79b tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:14:09.107035 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.compute.api [None req-b0208e5a-46ea-46b2-b8b3-6ae9406db79b tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120640) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:14:09.112435 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [req-7aab552a-91bc-412f-8a75-220d7090c4cb req-6a0209e1-9cb6-4736-83e6-642f95f7f374 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d25048e4-93d0-458e-bbe5-ba0a380f4b0c", "name": "network-vif-deleted", "tag": "430afbde-c047-4cf7-8a6c-587bd546651c"}]} {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 16:14:09.122978 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0208e5a-46ea-46b2-b8b3-6ae9406db79b tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:14:09.123565 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0208e5a-46ea-46b2-b8b3-6ae9406db79b tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:14:09.124017 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0208e5a-46ea-46b2-b8b3-6ae9406db79b tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:14:09.124711 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0208e5a-46ea-46b2-b8b3-6ae9406db79b tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:14:09.125163 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0208e5a-46ea-46b2-b8b3-6ae9406db79b tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:14:09.125583 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG oslo_concurrency.lockutils [None req-b0208e5a-46ea-46b2-b8b3-6ae9406db79b tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:14:09.125780 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-7aab552a-91bc-412f-8a75-220d7090c4cb req-6a0209e1-9cb6-4736-83e6-642f95f7f374 service nova] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:14:09.126479 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-7aab552a-91bc-412f-8a75-220d7090c4cb req-6a0209e1-9cb6-4736-83e6-642f95f7f374 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:14:09.126909 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [req-7aab552a-91bc-412f-8a75-220d7090c4cb req-6a0209e1-9cb6-4736-83e6-642f95f7f374 service nova] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:14:09.140231 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.compute.server_external_events [req-7aab552a-91bc-412f-8a75-220d7090c4cb req-6a0209e1-9cb6-4736-83e6-642f95f7f374 service nova] Creating event network-vif-deleted:430afbde-c047-4cf7-8a6c-587bd546651c for instance d25048e4-93d0-458e-bbe5-ba0a380f4b0c on hv-cinder-85331 Sep 07 16:14:09.145648 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [req-7aab552a-91bc-412f-8a75-220d7090c4cb req-6a0209e1-9cb6-4736-83e6-642f95f7f374 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036753 Sep 07 16:14:09.146244 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 637/1293] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Sep 7 16:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 16:14:09.194270 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.policy [None req-b0208e5a-46ea-46b2-b8b3-6ae9406db79b tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aa615f2c7c4c6eaa694f551e38436a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266789e160554ec0a0a334304a0ad39d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120640) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 16:14:09.202732 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-b0208e5a-46ea-46b2-b8b3-6ae9406db79b tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 200 len: 1381 microversion: 2.1 time: 0.100536 Sep 07 16:14:09.203373 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 657/1294] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:14:09 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 1381 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 16:14:10.228058 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dd246fba-6b00-43eb-9333-e79130ea4309 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '>' {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:14:10.228749 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.compute.api [None req-dd246fba-6b00-43eb-9333-e79130ea4309 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] [instance: d25048e4-93d0-458e-bbe5-ba0a380f4b0c] Fetching instance by UUID {{(pid=120641) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 16:14:10.234829 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd246fba-6b00-43eb-9333-e79130ea4309 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:14:10.235310 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd246fba-6b00-43eb-9333-e79130ea4309 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:14:10.235776 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd246fba-6b00-43eb-9333-e79130ea4309 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:14:10.236463 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd246fba-6b00-43eb-9333-e79130ea4309 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Acquiring lock "13f76085-40f9-4e0c-a81d-300476f83c4c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 16:14:10.236918 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd246fba-6b00-43eb-9333-e79130ea4309 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 16:14:10.237337 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG oslo_concurrency.lockutils [None req-dd246fba-6b00-43eb-9333-e79130ea4309 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Lock "13f76085-40f9-4e0c-a81d-300476f83c4c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 16:14:10.250830 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.wsgi [None req-dd246fba-6b00-43eb-9333-e79130ea4309 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] HTTP exception thrown: Instance d25048e4-93d0-458e-bbe5-ba0a380f4b0c could not be found. Sep 07 16:14:10.252438 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dd246fba-6b00-43eb-9333-e79130ea4309 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Request method failure captured: Sep 07 16:14:10.252438 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: request: GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c HTTP/1.1 Sep 07 16:14:10.252438 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Accept: application/json Sep 07 16:14:10.252438 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Accept-Encoding: identity Sep 07 16:14:10.252438 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Connection: close Sep 07 16:14:10.252438 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Content-Length: 0 Sep 07 16:14:10.252438 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Content-Type: application/json Sep 07 16:14:10.252438 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Host: 10.222.0.17 Sep 07 16:14:10.252438 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: Openstack-System-Scope: None Sep 07 16:14:10.252438 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: User-Agent: python-urllib3/1.26.12 Sep 07 16:14:10.252438 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Auth-Token: gAAAAABjGMHQ9bnxaSw-EOyzrrXuchZIkMsKIdietIVLnrwSf77-nNEbmcuOdEn5-sQA86bel7GSFzp5PwFhs3D0kILPKY-ZtbO1FRsJZVXA88aA6xpN0sfczQoP2nJYe7bw22nQ5GK8tnqstqJToQfPsn0iCrfKq-ed3g2kojobtiDESrKrFZo Sep 07 16:14:10.252438 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Domain-Id: None Sep 07 16:14:10.252438 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Domain-Name: None Sep 07 16:14:10.252438 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Identity-Status: Confirmed Sep 07 16:14:10.252438 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Is-Admin-Project: True Sep 07 16:14:10.252438 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Domain-Id: default Sep 07 16:14:10.252438 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Domain-Name: Default Sep 07 16:14:10.252438 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Id: 266789e160554ec0a0a334304a0ad39d Sep 07 16:14:10.252438 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Project-Name: tempest-TestShelveInstance-669421557 Sep 07 16:14:10.252438 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Role: reader,member Sep 07 16:14:10.252438 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Roles: reader,member Sep 07 16:14:10.254279 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_266789e160554ec0a0a334304a0ad39d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/266789e160554ec0a0a334304a0ad39d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/266789e160554ec0a0a334304a0ad39d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/266789e160554ec0a0a334304a0ad39d"}]}] Sep 07 16:14:10.254279 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant: tempest-TestShelveInstance-669421557 Sep 07 16:14:10.254279 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant-Id: 266789e160554ec0a0a334304a0ad39d Sep 07 16:14:10.254279 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-Tenant-Name: tempest-TestShelveInstance-669421557 Sep 07 16:14:10.254279 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User: tempest-TestShelveInstance-669421557-project Sep 07 16:14:10.254279 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Domain-Id: default Sep 07 16:14:10.254279 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Domain-Name: Default Sep 07 16:14:10.254279 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Id: 22aa615f2c7c4c6eaa694f551e38436a Sep 07 16:14:10.254279 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: X-User-Name: tempest-TestShelveInstance-669421557-project Sep 07 16:14:10.254279 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: method: > Sep 07 16:14:10.254279 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: exception: Instance d25048e4-93d0-458e-bbe5-ba0a380f4b0c could not be found. Sep 07 16:14:10.254279 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: action_args: {'id': 'd25048e4-93d0-458e-bbe5-ba0a380f4b0c'} Sep 07 16:14:10.255365 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: {{(pid=120641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 16:14:10.255365 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:14:10.255365 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 16:14:10.255365 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 16:14:10.255365 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 16:14:10.255365 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 16:14:10.255365 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 16:14:10.255365 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 16:14:10.255365 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 16:14:10.255365 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 16:14:10.255365 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d25048e4-93d0-458e-bbe5-ba0a380f4b0c could not be found. Sep 07 16:14:10.255365 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:14:10.255365 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:14:10.255365 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:14:10.255365 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:14:10.255365 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:14:10.255365 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:14:10.255365 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 16:14:10.255365 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 16:14:10.255365 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 16:14:10.257286 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 16:14:10.257286 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 16:14:10.257286 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 16:14:10.257286 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 16:14:10.257286 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 16:14:10.257286 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 16:14:10.257286 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 16:14:10.257286 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d25048e4-93d0-458e-bbe5-ba0a380f4b0c could not be found. Sep 07 16:14:10.257286 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:14:10.257286 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 16:14:10.257286 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:14:10.257286 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 16:14:10.257286 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 16:14:10.257286 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 16:14:10.257286 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 16:14:10.257286 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 16:14:10.257286 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d25048e4-93d0-458e-bbe5-ba0a380f4b0c could not be found. Sep 07 16:14:10.257286 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: ERROR nova.api.openstack.wsgi Sep 07 16:14:10.258883 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: DEBUG nova.api.openstack.wsgi [None req-dd246fba-6b00-43eb-9333-e79130ea4309 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Returning 404 to user: Instance d25048e4-93d0-458e-bbe5-ba0a380f4b0c could not be found. {{(pid=120641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 16:14:10.258883 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: INFO nova.api.openstack.requestlog [None req-dd246fba-6b00-43eb-9333-e79130ea4309 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c" status: 404 len: 111 microversion: 2.1 time: 0.031921 Sep 07 16:14:10.258883 dv-cinder-853315-8-iscsi devstack@n-api.service[120641]: [pid: 120641|app: 0|req: 638/1295] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Sep 7 16:14:10 2022] GET /compute/v2.1/servers/d25048e4-93d0-458e-bbe5-ba0a380f4b0c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 16:14:10.408837 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: DEBUG nova.api.openstack.wsgi [None req-9157c415-4e4e-4ad0-a916-ab4bea9328b4 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] Calling method '.version_select at 0x7ff9a5cc4820>' {{(pid=120640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 16:14:10.433543 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: INFO nova.api.openstack.requestlog [None req-9157c415-4e4e-4ad0-a916-ab4bea9328b4 tempest-TestShelveInstance-669421557 tempest-TestShelveInstance-669421557-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-170325714" status: 202 len: 0 microversion: 2.1 time: 0.028536 Sep 07 16:14:10.434132 dv-cinder-853315-8-iscsi devstack@n-api.service[120640]: [pid: 120640|app: 0|req: 658/1296] 10.222.0.17 () {58 vars in 1251 bytes} [Wed Sep 7 16:14:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-170325714 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)